[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
[Expired for util-linux (Ubuntu) because there has been no activity for 60 days.] ** Changed in: util-linux (Ubuntu) Status: Incomplete => Expired -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
Phillip - Thanks for this explanation. While I'm willing to look into the first two, please first note that (3) clearly does not hold. If you look in the syslog I linked (above), you will see repeatedly: Jan 8 18:27:08 Tyan-S2927 kernel: [2.804642] sdc: p2 size 1157233300 extends beyond EOD, truncated Jan 8 18:27:08 Tyan-S2927 kernel: [2.804747] sdc: p3 size 3023914186 extends beyond EOD, truncated Jan 8 18:27:08 Tyan-S2927 kernel: [2.804814] sdc: p4 size 3400475220 extends beyond EOD, truncated Whatever it's seeing are not within the bounds of the disk. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
The kernel code is looking for: 1) Each partition has the 1 bit set in its flags byte 2) Each partition's ID bytes are all ascii numbers 3) Each partition starts and ends within the bounds of the disk When these conditions are met, it sets up the partitions and states that the partition table type is "AHDI", which your syslog shows, so as unlikely as this seems, it must have happened. I suppose you can get a hex dump of the boot sector of this drive and see: sudo dd if=/dev/sda count=1 | hd > bootsect.txt ** Changed in: util-linux (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
Sorry, in #2 make that "is alphanumeric". -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
Phillip, the Atari Partition Table spec is located here: http://drac030.krap.pl/APT_spec.pdf You will notice that the header entry (bottom of p.2 to top of p.3) has a signature at offset 1 ("APT"). It also has a sanity check at offset 5. In addition, each partition entry points to both the previous and next entry. There are clearly sufficient tests here to see if there is really an Atari Partition Table present or not. I have filled six 2T disks, each with different random data, and I'm always getting the same result. There is no way this is happening randomly. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
** Changed in: util-linux (Ubuntu) Status: Invalid => New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
It seems that your random data just happens to look like an Atari partition table to the kernel. Parted and ( it would seem ) blkid do not support this format so they don't recognize any partitions, but the kernel does, and so gives you partitions. ** Changed in: util-linux (Ubuntu) Status: New => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
Also, have a look at the syslog: http://paste.ubuntu.com/14498427/ In addition to searching for /dev/sd{a,b,c}, you can also search for the word "truncate" in there. ** Changed in: util-linux (Ubuntu) Status: Incomplete => New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
Here, the formatting is slightly better in this pastebin: http://pastebin.com/dRh9RCfM -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
Yes, I have rebooted many times. Right now, I'm using them in a working system. What's more, I have two systems prepared similarly, one with raid and one without, and they are showing exactly the same problem. Here, have a look at one of these systems (raid). All the disks sd{a,b,c} are random filled with no luks header. They are mounted with an external header. sd{a,b} contain root/home and sdc (not mounted) is just data. @Tyan-S2927:~$ ls -l /dev/disk/by-id/wwn-* lrwxrwxrwx 1 root root 9 Jan 14 11:16 /dev/disk/by-id/wwn-0x50014ee207XX -> ../../sdb lrwxrwxrwx 1 root root 9 Jan 14 11:16 /dev/disk/by-id/wwn-0x50014ee208XX -> ../../sdc lrwxrwxrwx 1 root root 10 Jan 14 11:16 /dev/disk/by-id/wwn-0x50014ee208XX-part2 -> ../../sdc2 lrwxrwxrwx 1 root root 10 Jan 14 11:16 /dev/disk/by-id/wwn-0x50014ee208XX-part3 -> ../../sdc3 lrwxrwxrwx 1 root root 10 Jan 14 11:16 /dev/disk/by-id/wwn-0x50014ee208XX-part4 -> ../../sdc4 lrwxrwxrwx 1 root root 9 Jan 14 11:16 /dev/disk/by-id/wwn-0x50014ee25XX -> ../../sda lrwxrwxrwx 1 root root 10 Jan 14 11:16 /dev/disk/by-id/wwn-0x50014ee25XX-part2 -> ../../sda2 @Tyan-S2927:~$ lsblk NAME MAJ:MIN RMSIZE RO TYPE MOUNTPOINT sda8:001.8T 0 disk ├─sda2 8:201.6T 0 part └─luks.root1 252:001.8T 0 crypt /home sdb8:16 01.8T 0 disk └─luks.root2 252:101.8T 0 crypt sdc8:32 01.8T 0 disk ├─sdc2 8:34 0 499.7G 0 part ├─sdc3 8:35 0 1000.3G 0 part └─sdc4 8:36 0 130.7G 0 part sdd8:48 1 28.9G 0 disk └─sdd1 8:49 1 28.9G 0 part /boot @Tyan-S2927:~$ sudo blkid -p /dev/sda @Tyan-S2927:~$ sudo blkid -p /dev/sdb @Tyan-S2927:~$ sudo blkid -p /dev/sdc @Tyan-S2927:~$ mount | column -t sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime) procon /proctype proc (rw,nosuid,nodev,noexec,relatime) udevon /dev type devtmpfs (rw,nosuid,relatime,size=12326324k,nr_inodes=3081581,mode=755) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,noexec,relatime,size=2475548k,mode=755) /dev/mapper/luks.root1 on /type btrfs (rw,noatime,nodiratime,compress=lzo,space_cache,autodefrag,subvolid=258,subvol=/@) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev) tmpfs on /run/locktype tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k) tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct) cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio) cgroup on /sys/fs/cgroup/cpusettype cgroup (rw,nosuid,nodev,noexec,relatime,cpuset,clone_children) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/memorytype cgroup (rw,nosuid,nodev,noexec,relatime,memory) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/perf_eventtype cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=21,pgrp=1,timeout=0,minproto=5,maxproto=5,direct) debugfs on /sys/kernel/debugtype debugfs (rw,relatime) mqueue on /dev/mqueue type mqueue (rw,relatime) hugetlbfs on
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
Did you reboot after filling the drive with random data? Also please run sudo blkid -p /dev/sda ( or whichever disk is effected ) and post the output. ** Changed in: util-linux (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
apport information ** Tags added: apport-collected wily ** Description changed: I have two 2T disks with no partition table and which have been filled with random data. GNU parted shows nothing on this disk: GNU Parted 3.2 Using /dev/sda Welcome to GNU Parted! Type 'help' to view a list of commands. (parted) print Error: /dev/sda: unrecognised disk label Model: ATA WDC WD2002FAEX-0 (scsi) Disk /dev/sda: 2000GB Sector size (logical/physical): 512B/512B Partition Table: unknown Disk Flags: but when I check with `lsblk`, I see one disk with partitions and the other without: Code: NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 1.8T 0 disk └─sda2 8:2 0 1.6T 0 part NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sdb 8:16 0 1.8T 0 disk and the Disks utility agrees (see: http://ibin.co/2SQv4KbH06Mz). Also, /dev/disk/by-id contains an entry pointing to sda and one pointing to sda2. So it really does think there's a second partition there. Thinking there was something wrong, I re-filled the disks with random data. Now sda is properly (in the Disks utility as just an "unknown disk"), but sdb shows a second partition, and identically to how sda was showing it before (ie the Disks utility output is the same with 181GB at the beginning and 128GB at the end). I am running all this from the Ubuntu Gnome 15.10 installer disk. + --- + ApportVersion: 2.19.1-0ubuntu5 + Architecture: amd64 + CurrentDesktop: GNOME + DistroRelease: Ubuntu 15.10 + InstallationDate: Installed on 2015-08-31 (130 days ago) + InstallationMedia: Ubuntu-GNOME 15.10 "Wily Werewolf" - Release amd64 (20151021) + Package: util-linux 2.26.2-6ubuntu3 + PackageArchitecture: amd64 + ProcEnviron: + TERM=xterm-256color + PATH=(custom, no user) + XDG_RUNTIME_DIR= + LANG=en_US.UTF-8 + SHELL=/bin/bash + ProcVersionSignature: Ubuntu 4.2.0-23.28-generic 4.2.6 + Tags: wily + Uname: Linux 4.2.0-23-generic x86_64 + UpgradeStatus: No upgrade log present (probably fresh install) + UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo + _MarkForUpload: True ** Attachment added: "Dependencies.txt" https://bugs.launchpad.net/bugs/1531404/+attachment/4546400/+files/Dependencies.txt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
Prompted by a chat on #ubuntu-bugs, I'll point this out: (1) Since an MBR has a signature at the end, 0x55AA, then what we're seeing should not be happening. It's possible in all but 1 in 65536 cases to definitively identify that there is no partition table on the disk. (2) Even in that small chance that the signature is there "randomly" (on a random filled disk), partition entries would also show up randomly. They would not show up specifically at 181GB into the disk. Therefore, something that we shouldn't expect is going on here. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
It's not really a linux utility problem, nor a gnome-disk-utility problem. Whatever is identifying devices is making a mistake. ** Package changed: ubuntu => util-linux (Ubuntu) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/util-linux/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1531404] Re: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks
Because of this bug: https://bugs.launchpad.net/ubuntu/+bug/1531478 I am not able to run apport to collect system data. (Apport needs an ok through the browswer.) If anyone has another way of doing it, I'm happy to take suggestions. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1531404 Title: nonexistent partition in /dev, & lsblk/disk util misbehaving with randomized disks To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+bug/1531404/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs