Re: random-id / modulate state help
On Wed, Jul 31, 2024, at 6:10 PM, Marcus Oldman wrote: > I have an OpenBSD router at home that uses a few PF lines like the following: > > match in all scrub (no-df random-id reassemble tcp) > (...) > pass out quick inet modulate state > > I've read the pf.conf man page and have a mild understanding of the > "random-id" and "modulate state" bits, but still don't fully understand > when and why they should be used or not used. > > The router is in front of a mix of devices and different OSes. Should I > be using these 2 features for security purposes? There's nothing wrong with them, even if the devices behind your firewall are modern and less likely to benefit from them. The pf.conf man page will better explain the pros/cons than I could here. > I'm trying to diagnose some slowness and inconsistency in my home > internet and didn't know if these might be slowing things down. The > hardware is just an APU2, so nothing very powerful. Less than 1gbit > connection. I would remove 'reassemble tcp'. I've found it causes more problems than it solves. Brian Conway Owner RCE Software, LLC
random-id / modulate state help
I have an OpenBSD router at home that uses a few PF lines like the following: match in all scrub (no-df random-id reassemble tcp) (...) pass out quick inet modulate state I've read the pf.conf man page and have a mild understanding of the "random-id" and "modulate state" bits, but still don't fully understand when and why they should be used or not used. The router is in front of a mix of devices and different OSes. Should I be using these 2 features for security purposes? I'm trying to diagnose some slowness and inconsistency in my home internet and didn't know if these might be slowing things down. The hardware is just an APU2, so nothing very powerful. Less than 1gbit connection.
A Write-up on Fighting SPAM with the help of OpenBSD
Greetings, I composed a (somewhat opinionated) write-up on my blog about fighting SPAM with the help of OpenBSD and rspamd. The reason I'm writing about it on this list is that I want to give a shoutout Joel Carnat for his excellent write-up on the subject (linked in my post). I would love to hear your thoughts and any additional insight you might have on the topic. https://public-exposure.inform.social/post/a-tour-through-the-spam-fighting-state-of-the-art/ Best regards, Lari Huttunen -- Current projects: - https://www.huttu.net | hacking for good - https://public-exposure.inform.social | a blog on defensive cyber security
Re: accidentally overwritten wrong drive with DD, please help
Jan Stary: > > > > > Why did you have your crypto volume as an 'i' partition? > > > > Why? Because it says so in the manual, what do you mean?? > > > In what manual does it say to create an 'i' partition specificaly? > > https://www.openbsd.org/faq/faq14.html#softraidCrypto > > Does anyone know why it's "i" specificaly? I guess it was copied one way or another from an older example of setting up a USB drive for the purpose of data exchange. There is no technical reason to use 'i' there, but then again you can do so. > Does is have anything to do with "i" being > traditionaly a msdos partition? Historically, BSD disklabels had 8 slots, 'a'...'h', so 'i' was clearly not a BSD partition. When OpenBSD extended disklabels to 16 slots, 'a'...'p', things became ambiguous. -- Christian "naddy" Weisgerber na...@mips.inka.de
Re: accidentally overwritten wrong drive with DD, please help
> > > > Why did you have your crypto volume as an 'i' partition? > > > Why? Because it says so in the manual, what do you mean?? > > In what manual does it say to create an 'i' partition specificaly? > https://www.openbsd.org/faq/faq14.html#softraidCrypto Does anyone know why it's "i" specificaly? Does is have anything to do with "i" being traditionaly a msdos partition? > > In that case, the image should have copies of the superblock. > Is that good? Well yes: you have definitely lost the actual superblock of the ffs filesystem you originaly created, but newfs creates copies of the superblock, pretty far out in the fs. See the -b option of fsck. > > > > > 4.5. and verified with sha512 that rsd3i is same as > > > > > /mnt/hdd/ssdimage, even > > > > > though the ssdimage on the backup drive is 19G larger in size > > > > > > > > No. If one is 19G greater that the other, they cannot have the same > > > > hash. > > > > So what exactly do you mean by the sizes? Where did you get them? > > > > > > Duh! But that's what `df -h` said! > > > > df -h is not the size of the /dev/rsd3i 'file'. > > Oh, weird No, that's not weird. What df -h reports about a filesystem is not the size of the image of that filesystem obtained with dd. So if you made a dd image of sdXi with dd, then sdXi and itd dd image will have the same hash of course, but the broken filesystem on sdXi will not have the same "size".
Re: accidentally overwritten wrong drive with DD, please help
On Thu, Jul 04, 2024 at 06:53:39PM +0200, Jan Stary wrote: > On Jul 02 18:52:50, anonl...@autistici.org wrote: > > On Mon, Jul 01, 2024 at 08:29:53AM +0200, Jan Stary wrote: > > > > 1. I had a drive SSD sd2a which had a 200G crypto volume sd3i which was > > > > mounted > > > > on /mnt/ssd, all 1 partition > > > > > > Why did you have your crypto volume as an 'i' partition? > > > > Why? Because it says so in the manual, what do you mean?? > > In what manual does it say to create an 'i' partition specificaly? https://www.openbsd.org/faq/faq14.html#softraidCrypto Here > > > How did you create the filesystem that was on sd3i? > > Well? With the above link > > > How exactly did you 'copy /dev/rsd3i as an image'? > > `dd if=/dev/rsd3i of=/mnt/hdd/ssd-image bs=1m` > > In that case, the image should have copies of the superblock. Is that good? > > > > 4.5. and verified with sha512 that rsd3i is same as /mnt/hdd/ssdimage, > > > > even > > > > though the ssdimage on the backup drive is 19G larger in size > > > > > > No. If one is 19G greater that the other, they cannot have the same hash. > > > So what exactly do you mean by the sizes? Where did you get them? > > > > Duh! But that's what `df -h` said! > > df -h is not the size of the /dev/rsd3i 'file'. Oh, weird
Re: accidentally overwritten wrong drive with DD, please help
On Jul 02 18:52:50, anonl...@autistici.org wrote: > On Mon, Jul 01, 2024 at 08:29:53AM +0200, Jan Stary wrote: > > > 1. I had a drive SSD sd2a which had a 200G crypto volume sd3i which was > > > mounted > > > on /mnt/ssd, all 1 partition > > > > Why did you have your crypto volume as an 'i' partition? > > Why? Because it says so in the manual, what do you mean?? In what manual does it say to create an 'i' partition specificaly? > > How did you create the filesystem that was on sd3i? Well? > > How exactly did you 'copy /dev/rsd3i as an image'? > `dd if=/dev/rsd3i of=/mnt/hdd/ssd-image bs=1m` In that case, the image should have copies of the superblock. > > > 4.5. and verified with sha512 that rsd3i is same as /mnt/hdd/ssdimage, > > > even > > > though the ssdimage on the backup drive is 19G larger in size > > > > No. If one is 19G greater that the other, they cannot have the same hash. > > So what exactly do you mean by the sizes? Where did you get them? > > Duh! But that's what `df -h` said! df -h is not the size of the /dev/rsd3i 'file'. > > > 5. Whilst writing this e-mail I realized that I might have made > > > a fatal mistake. I think that I backed up rsd3i instead of rsd3c > > > > Tools differ. Some might work with an image of the (broken) filesystem, > > which is what you have. (What filesystem was it?) Some expect an image > > of the entire disk. > > > > > (I was being extremely careful) > > > > LOL > > > > It's FFS, of course :) > Well one of the tools said raw disk, so that one's out of the window.. > I think that testdisk's photorec might work.. I've been busy so didn't get to > try it yet > >
Re: accidentally overwritten wrong drive with DD, please help
On Mon, Jul 01, 2024 at 08:29:53AM +0200, Jan Stary wrote: > > 1. I had a drive SSD sd2a which had a 200G crypto volume sd3i which was > > mounted > > on /mnt/ssd, all 1 partition > > Why did you have your crypto volume as an 'i' partition? > How did you create the filesystem that was on sd3i? Why? Because it says so in the manual, what do you mean?? > > 2. I did a `dd if=/dev/urandom of=/dev/rsd3c bs=1m` > > for a little over 74M then I stopped approximately 7 seconds later > > You are screwed. :( don't say that > > > 3. After the DD, I couldn't access /mnt/ssd, it said no such file or > > directory > > > > 4. I now have a HDD which I repurposed to be my backup, > > and I copied /dev/rsd3i over to the HDD as an image > > How exactly did you 'copy /dev/rsd3i as an image'? `dd if=/dev/rsd3i of=/mnt/hdd/ssd-image bs=1m` I think > > 4.5. and verified with sha512 that rsd3i is same as /mnt/hdd/ssdimage, even > > though the ssdimage on the backup drive is 19G larger in size > > No. If one is 19G greater that the other, they cannot have the same hash. > So what exactly do you mean by the sizes? Where did you get them? Duh! But that's what `df -h` said! > > 5. Whilst writing this e-mail I realized that I might have made > > a fatal mistake. I think that I backed up rsd3i instead of rsd3c > > Tools differ. Some might work with an image of the (broken) filesystem, > which is what you have. (What filesystem was it?) Some expect an image > of the entire disk. > > > (I was being extremely careful) > > LOL > It's FFS, of course :) Well one of the tools said raw disk, so that one's out of the window.. I think that testdisk's photorec might work.. I've been busy so didn't get to try it yet
Re: accidentally overwritten wrong drive with DD, please help
> 1. I had a drive SSD sd2a which had a 200G crypto volume sd3i which was > mounted > on /mnt/ssd, all 1 partition Why did you have your crypto volume as an 'i' partition? How did you create the filesystem that was on sd3i? > 2. I did a `dd if=/dev/urandom of=/dev/rsd3c bs=1m` > for a little over 74M then I stopped approximately 7 seconds later You are screwed. > 3. After the DD, I couldn't access /mnt/ssd, it said no such file or directory > > 4. I now have a HDD which I repurposed to be my backup, > and I copied /dev/rsd3i over to the HDD as an image How exactly did you 'copy /dev/rsd3i as an image'? > 4.5. and verified with sha512 that rsd3i is same as /mnt/hdd/ssdimage, even > though the ssdimage on the backup drive is 19G larger in size No. If one is 19G greater that the other, they cannot have the same hash. So what exactly do you mean by the sizes? Where did you get them? > 5. Whilst writing this e-mail I realized that I might have made > a fatal mistake. I think that I backed up rsd3i instead of rsd3c Tools differ. Some might work with an image of the (broken) filesystem, which is what you have. (What filesystem was it?) Some expect an image of the entire disk. > (I was being extremely careful) LOL
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 29, 2024 at 03:00:42AM -0400, Steve Litt wrote: > Anon Loli said on Fri, 28 Jun 2024 21:43:00 + > > > >I have autism, please be patient ._. > > I know little about autism. Is one symptom aversion to > revisiting/rethinking policy decisions in the face of new situations > where those policy decisions cause you trouble? > > Policy decisions are a necessary part of life. Nobody wants to do a > cost/benefit analysis before performing a task they've done 1000 times > before. But once in a while policies produce problems and should either > be changed or temporarily, for this one situation, discarded. In my > opinion you're in just such a situation now. My suggestion is you pick a > role model without autism, and pretend to be him while making decisions > in this circumstance. > > Among my other professions I'm a technical writer, and the #1 > requirement for tech writing is elimination of all ambiguity. If I were > in your shoes, I'd make a block diagram of your exact situation. > Inkscape is a great tool for block diagrams. The block diagram, plus > some narrative text explaining and describing the situation, in the > exact terms as printed on the diagram, goes a long way toward ambiguity > elimination. > > SteveT > > Steve Litt > > http://444domains.com > Why make a block diagram, did you not understand my situation? Did I not explain it well? I used and will utilize block diagrams/flowcharts in my projects, so I understand how important they are, humans and animals are good visual learners It's simple I think (although there were some difficulties in the mid-section), here comes a primitive flowchart: 1. I had a drive SSD sd2a which had a 200G crypto volume sd3i which was mounted on /mnt/ssd, all 1 partition 2. I did a `dd if=/dev/urandom of=/dev/rsd3c bs=1m` for a little over 74M then I stopped approximately 7 seconds later 3. After the DD, I couldn't access /mnt/ssd, it said no such file or directory 4. I now have a HDD which I repurposed to be my backup, and I copied /dev/rsd3i over to the HDD as an image 4.5. and verified with sha512 that rsd3i is same as /mnt/hdd/ssdimage, even though the ssdimage on the backup drive is 19G larger in size 5. Whilst writing this e-mail I realized that I might have made a fatal mistake. I think that I backed up rsd3i instead of rsd3c, do you agree that this is a worse mistake than the DD overwrite of the wrong drive? Why you might ask? Because the sd3 crypto volume isn't mounted anymore, IDK if OpenBSD got bored with it being broken for 1 week, or I somehow accidentally unplugged it (I was being extremely careful), whatever the case might be, I no longer can make a backup of rsd3c, so all that I now have is, sadly, only a rsd3i 6. I was told to use fsdb, photorec from testdrive and/or sleuthkit to try and recover my DDd over filesystem and files. So, I guess that I needed a copy of rsd3c, not rsd3i? Am I screwed? I'm so stupid :d P.S. I think that MTpaint is much better in terms of dependency bloat hell compared to Inkscape
Re: accidentally overwritten wrong drive with DD, please help
Anon Loli said on Fri, 28 Jun 2024 21:43:00 + >I'm sorry for not using rsync, I don't like replcaing utilitites that >are already present in OpenBSD and have served me well so far (except >this caes where it was my fault user error :( ) Rsync's the best, but if you don't want it, by all means cp -Rp src dst Or, if the copy is going on your 10Mbit network, use that old tar on one end and untar on the other trick. Sorry I can't elaborate, but I use rsync. SteveT Steve Litt http://444domains.com
Re: accidentally overwritten wrong drive with DD, please help
On Fri, Jun 28, 2024 at 09:46:55PM +, Anon Loli wrote: > photorec isn't in the ports tree It's part of the port for testdisk. -- lumidify
Re: accidentally overwritten wrong drive with DD, please help
On Thu, Jun 27, 2024 at 02:49:07PM -0600, Andy Bradford wrote: > Thus said Anon Loli on Thu, 27 Jun 2024 04:12:57 -: > > > No kidding? The 1st few people made it sound like it's going to be > > relatively easy :( > > I don't think anyone said it was going to be easy, only that your > primary focus should be simply to get a good copy of the raw unencrypted > partition while it was still available using simple techniques as > quickly as possible. > > If you have obtained it, your next goal should be to figure out now what > to do with it. As I understand it, you wrote 74MB of garbage at the > front of that partition. This will have undoubtedly destroyed filesystem > metadata and some other data. Can the filesystem be "recreated" in the > first 74MB as just empty filesystem space while leaving the rest of the > existing data and filesystem in tact? I don't know the answer to that. > Maybe there is someone with more FFS experience that does. Presumably > you know the exact size of the partition and so could at least recreate > an empty filesystem using newfs with the same parameters. Could it > possible to then stich in or reattach chunks of data into this from your > copy? Again, I don't know. Who does? > > Any work you do at recovery should be done on yet another copy of the > same data so that you can keep one "master" copy around just in case. > > Some tools for recovering files can be found in packages like sleuthkit > and testdisk. There may be others of which I'm unaware. > > Andy > I'll see what I can do with Sleuth Kit, thanks!
Re: accidentally overwritten wrong drive with DD, please help
On Fri, Jun 28, 2024 at 10:12:56AM +0200, lumidify wrote: > On Thu, Jun 27, 2024 at 10:49:41PM +0100, Kirill A. Korinsky wrote: > > I suggest you to use some software that may scan your image and try to > > extract something. But I can't suggest anything which may support OpenBSD > > FS. > > If all else fails, photorec should be able to extract many files still (but > without any file names). It's just a pain to actually do anything with the > recovered files since all metadata is lost. Of course, you have to run > photorec on the unencrypted image, not the encrypted drive. > > -- > lumidify photorec isn't in the ports tree
Re: accidentally overwritten wrong drive with DD, please help
On Thu, Jun 27, 2024 at 04:39:09PM -0400, Steve Litt wrote: > Anon Loli said on Thu, 27 Jun 2024 04:12:57 + > > >On Wed, Jun 26, 2024 at 11:34:02PM -0400, Steve Litt wrote: > >> Anon Loli said on Wed, 26 Jun 2024 16:17:35 + > > >> But wait. Unless that "other drive" is somehow hotpluggable (like > >> USB), you'll need to shut down the computer to plug it in, and it's > >> way too soon in this process to turn off that computer. > > > >Why? I have it plugged in already and I've successfully not only DDd > >to the backup drive, but also verified that the data on both SSD and > >the backup HDD is the same sha512 hash, even if there's a 19G > >difference in size > > I don't understand exactly what you did. > > >> >the /mnt/hdd is the mountpoint of the crypto volume of the secondary > >> >disk, and then somehow reformat the sd2/3 (the SSD with the > >> >corrupted FS), and then copy over the corrupted image backup from > >> >the HDD? > >> > >> The backup from your dd command isn't reliable, because garbage in > >> garbage out. dd makes a byte for byte copy --- it doesn't heal > >> anything. > > > >But the steps that I already took is good, right? > > You seem to be in an improved situation. > > > Is my corrupt data > >backed up at least? > > You're difficult to understand, but it sounds like your corrupt data is > backed up to your computer's other disk, in some form or other. > > >I need the raw disc copy, not the sd3i copy, > >right? Should I copy both? I have space > > The more the merrier, if you really have the space. Once again, I'm > concerned if you're copying to a disk already in use on your computer. > Be sure you filenames clearly identify which is which. > > > >> >(I got the adapter now, over the network it'd take many days, not > >> >counting broken pipes and what-not > >> > >> 200GB, many days? What are you dealing with, 10Mbit? > >> > >> > > >> >I didn't understand 100% of what you wrote, but if I understand > >> >correctly this is the simpler version of what you recommended, yes? > >> >(no idea what ddrescue is compared to dd) > >> > >> ddrescue helps with iffy disk sectors. > > > >why is everyone recommending rsync then? > > Because at one point you had said you have a mount containing the > unencrypted files. If this had been true, rsync would have been > cleanest and easiest. But your subsequent email stated you do NOT have > a mount containing unencrypted files. Also, nobody said rsync should be > the *only* copy you made, but if it had been possible it should have > been the first. > > >> >In that case the worst problem then would be how to get a > >> >functioning filesystem out of that image of the corrupted system? > >> >(assuming the raw disk of the crypto volume is the image of the > >> >filesystem, should be) > >> > >> I thought you currently have a mount of this partition that's > >> unencrypted. That's sure what it sounded like you said. If so, for > >> gosh sakes, copy all those files somewhere safe before turning off > >> the computer. > > > >I do, it's on /mnt/ssd, but it says no such directory even though `df > >-h` says otherwise > > *What* says "no such directory"? If you can't read the data, then you > don't really have an unencrypted partition, even if /mnt/ssd formerly > contained unencrypted readable files. > > You really need to express yourself unambiguously. And all this > misunderstanding is why every single person advised you to keep it > simple. > > > > > > >> >Or you people keep on saying something like "do this and this and > >> >then backup/save files and directories", but I can't do that if I > >> >can't read the files directly, so how to do it indirectly? > >> > >> It sounded like you were saying you have a mount with an unencrypted > >> version of the files. If not, please forget the step I mentioned > >> about rsyncing the files somewhere else. > > > >I do > > There you go again. Just a few paragraphs ago you said you can't read > it. Please write for clarity and unambiguousness. > > > > > > >> >I copied the image with the above command to the backup drive, what > >> >worries me is the following size on respective disks: > >> >primary disk (SSD with the corrupted crypto volume filesystem): used > >> >220G secondary disk (the backup HDD): used 239G > >> > >> I hope the capacity of that backup disk is more than 239GB, because > >> that would be cutting it pretty tight. Maybe you had 19GB of stuff on > >> the backup drive before doing this operation? > >> > >> > > >> >Why is the size like 19G difference? Does it have something to do > >> >with me DDing over the 1st 74M of the primary disk? > >> > >> OK, here I'm not understanding you at all. > > > >data on original disk SSD - is 220G > > Measured with what command? > > >data on the backup HDD that I just DDd and VERIFIED - is 239G > > 239GB measured with what command? > > And what do you mean "data on original disk SSD"? At this point that > SSD
Re: accidentally overwritten wrong drive with DD, please help
On Thu, Jun 27, 2024 at 10:49:41PM +0100, Kirill A. Korinsky wrote: > I suggest you to use some software that may scan your image and try to > extract something. But I can't suggest anything which may support OpenBSD FS. If all else fails, photorec should be able to extract many files still (but without any file names). It's just a pain to actually do anything with the recovered files since all metadata is lost. Of course, you have to run photorec on the unencrypted image, not the encrypted drive. -- lumidify
Re: accidentally overwritten wrong drive with DD, please help
On Thu, 27 Jun 2024 21:33:15 +0100, Anon Loli wrote: > > It'd be nice if someone can share any experiences with this matter (which > fall under the > conditions that which I imposed on myself), especially fsdb, assuming that it > can actually help in this matter... in an understandable fashion... unless I > waste 5 days on it (and still get nothing lol) > Something like 20 years ago I had reformated XFS with some data and rebuild it's from scratch. I have lost almost none metadata, and it was possible to rebuild. It took me couple of weeks to do it. Your case much worst. I have no idea how FFS is designed, but I bet that you had lost all your file names. Anyway, content of files should be intact that can be extracted with some kind of fuzzy search. But if you have some encrypted blobs, find them can be another challenge. Can you rebuild your FS from scratch by hand? Well, it is possible, but I think that you need to invest months, maybe years, of work. > > So as far as I understand, because of the 1st 74M being gone (the index of the > FS and stuff I'm guessing), that's like the entire FS is corrupt, so I'm > guessing I'd somehow have to go trough the entire 220/239G of data with > fsdb... > and my guess is that it won't be fast > I suggest you to use some software that may scan your image and try to extract something. But I can't suggest anything which may support OpenBSD FS. -- wbr, Kirill
Re: accidentally overwritten wrong drive with DD, please help
Thus said Anon Loli on Thu, 27 Jun 2024 04:12:57 -: > No kidding? The 1st few people made it sound like it's going to be > relatively easy :( I don't think anyone said it was going to be easy, only that your primary focus should be simply to get a good copy of the raw unencrypted partition while it was still available using simple techniques as quickly as possible. If you have obtained it, your next goal should be to figure out now what to do with it. As I understand it, you wrote 74MB of garbage at the front of that partition. This will have undoubtedly destroyed filesystem metadata and some other data. Can the filesystem be "recreated" in the first 74MB as just empty filesystem space while leaving the rest of the existing data and filesystem in tact? I don't know the answer to that. Maybe there is someone with more FFS experience that does. Presumably you know the exact size of the partition and so could at least recreate an empty filesystem using newfs with the same parameters. Could it possible to then stich in or reattach chunks of data into this from your copy? Again, I don't know. Who does? Any work you do at recovery should be done on yet another copy of the same data so that you can keep one "master" copy around just in case. Some tools for recovering files can be found in packages like sleuthkit and testdisk. There may be others of which I'm unaware. Andy
Re: accidentally overwritten wrong drive with DD, please help
Anon Loli said on Thu, 27 Jun 2024 04:12:57 + >On Wed, Jun 26, 2024 at 11:34:02PM -0400, Steve Litt wrote: >> Anon Loli said on Wed, 26 Jun 2024 16:17:35 + >> But wait. Unless that "other drive" is somehow hotpluggable (like >> USB), you'll need to shut down the computer to plug it in, and it's >> way too soon in this process to turn off that computer. > >Why? I have it plugged in already and I've successfully not only DDd >to the backup drive, but also verified that the data on both SSD and >the backup HDD is the same sha512 hash, even if there's a 19G >difference in size I don't understand exactly what you did. >> >the /mnt/hdd is the mountpoint of the crypto volume of the secondary >> >disk, and then somehow reformat the sd2/3 (the SSD with the >> >corrupted FS), and then copy over the corrupted image backup from >> >the HDD? >> >> The backup from your dd command isn't reliable, because garbage in >> garbage out. dd makes a byte for byte copy --- it doesn't heal >> anything. > >But the steps that I already took is good, right? You seem to be in an improved situation. > Is my corrupt data >backed up at least? You're difficult to understand, but it sounds like your corrupt data is backed up to your computer's other disk, in some form or other. >I need the raw disc copy, not the sd3i copy, >right? Should I copy both? I have space The more the merrier, if you really have the space. Once again, I'm concerned if you're copying to a disk already in use on your computer. Be sure you filenames clearly identify which is which. >> >(I got the adapter now, over the network it'd take many days, not >> >counting broken pipes and what-not >> >> 200GB, many days? What are you dealing with, 10Mbit? >> >> > >> >I didn't understand 100% of what you wrote, but if I understand >> >correctly this is the simpler version of what you recommended, yes? >> >(no idea what ddrescue is compared to dd) >> >> ddrescue helps with iffy disk sectors. > >why is everyone recommending rsync then? Because at one point you had said you have a mount containing the unencrypted files. If this had been true, rsync would have been cleanest and easiest. But your subsequent email stated you do NOT have a mount containing unencrypted files. Also, nobody said rsync should be the *only* copy you made, but if it had been possible it should have been the first. >> >In that case the worst problem then would be how to get a >> >functioning filesystem out of that image of the corrupted system? >> >(assuming the raw disk of the crypto volume is the image of the >> >filesystem, should be) >> >> I thought you currently have a mount of this partition that's >> unencrypted. That's sure what it sounded like you said. If so, for >> gosh sakes, copy all those files somewhere safe before turning off >> the computer. > >I do, it's on /mnt/ssd, but it says no such directory even though `df >-h` says otherwise *What* says "no such directory"? If you can't read the data, then you don't really have an unencrypted partition, even if /mnt/ssd formerly contained unencrypted readable files. You really need to express yourself unambiguously. And all this misunderstanding is why every single person advised you to keep it simple. > > >> >Or you people keep on saying something like "do this and this and >> >then backup/save files and directories", but I can't do that if I >> >can't read the files directly, so how to do it indirectly? >> >> It sounded like you were saying you have a mount with an unencrypted >> version of the files. If not, please forget the step I mentioned >> about rsyncing the files somewhere else. > >I do There you go again. Just a few paragraphs ago you said you can't read it. Please write for clarity and unambiguousness. > > >> >I copied the image with the above command to the backup drive, what >> >worries me is the following size on respective disks: >> >primary disk (SSD with the corrupted crypto volume filesystem): used >> >220G secondary disk (the backup HDD): used 239G >> >> I hope the capacity of that backup disk is more than 239GB, because >> that would be cutting it pretty tight. Maybe you had 19GB of stuff on >> the backup drive before doing this operation? >> >> > >> >Why is the size like 19G difference? Does it have something to do >> >with me DDing over the 1st 74M of the primary disk? >> >> OK, here I'm not understanding you at all. > >data on original disk SSD - is 220G Measured with what command? >data on the backup HDD that I just DDd and VERIFIED - is 239G 239GB measured with what command? And what do you mean "data on original disk SSD"? At this point that SSD is nothing but a drive with at least one partition. >how can there be a 19G difference in a same file (DDd image or >whatever it's called), and still be the same hash? [snip] >No kidding? The 1st few people made it sound like it's going to be >relatively easy :( Like you say, easy is relative. Several days ag
Re: accidentally overwritten wrong drive with DD, please help
And also thanks to everyone who helped and/or tried to help... I'll try the fsdb utility when I'll have a chance to do it, at least fsdb(8) says that it usually opens a raw disk partition, which I have, so there's that :/ It'd be nice if someone can share any experiences with this matter (which fall under the conditions that which I imposed on myself), especially fsdb, assuming that it can actually help in this matter... in an understandable fashion... unless I waste 5 days on it (and still get nothing lol) A filesystem is like a big part of an operating system, in my opinion, because a lot of things are a file (if not all), and a FS is a system of that, so it's like a foundation of sorts, so good to learn it, just dunno if I'll be capable to consume it's likely monstrous (subjective) difficulty So as far as I understand, because of the 1st 74M being gone (the index of the FS and stuff I'm guessing), that's like the entire FS is corrupt, so I'm guessing I'd somehow have to go trough the entire 220/239G of data with fsdb... and my guess is that it won't be fast
Re: accidentally overwritten wrong drive with DD, please help
On Thu, Jun 27, 2024 at 05:17:58PM -, Stuart Henderson wrote: > On 2024-06-27, Anon Loli wrote: > > On Thu, Jun 27, 2024 at 01:12:05PM +0100, Kirill A. Korinsky wrote: > >> On Thu, 27 Jun 2024 05:12:57 +0100, > >> Anon Loli wrote: > >> > >> Right now we have some comercial and open-source software which may support > >> OpenBSD FS, or may simple make a search in data to get some files. > > > > I'm not using anything commercial OR proprietary > > You'd best get familiar with fs(5), fsdb(8) and all the documentation > you can get your hands on about UFS/FFS implementation then. oh, no... :( why I was so stupid... I worked so hard and carefully when handling that backup SSD... one time I'm in a hurry and didn't double-check the device I'm DDing to, and everything (most likely) went to shit... > > No one is getting any image or file or anything from me, and I'm not > > sending my > > drives to anyone. This might sound rude or stupid to you, I'm sorry, but > > that's > > not debatable.. > > Levels of paranoia make me wonder about this email username you're using. :( I'm loli, be nice pls > > Can't I just need to somehow fix the 1st 74M, and then somehow magically the > > "just" and "somehow" are doing *heavy* lifting there. > > Anyway I have no more I can add so I'm ducking out of this thread. > Thanks and fly well (like ducks usually do)
Re: accidentally overwritten wrong drive with DD, please help
On 2024-06-27, Anon Loli wrote: > On Thu, Jun 27, 2024 at 01:12:05PM +0100, Kirill A. Korinsky wrote: >> On Thu, 27 Jun 2024 05:12:57 +0100, >> Anon Loli wrote: >> >> Right now we have some comercial and open-source software which may support >> OpenBSD FS, or may simple make a search in data to get some files. > > I'm not using anything commercial OR proprietary You'd best get familiar with fs(5), fsdb(8) and all the documentation you can get your hands on about UFS/FFS implementation then. > No one is getting any image or file or anything from me, and I'm not sending > my > drives to anyone. This might sound rude or stupid to you, I'm sorry, but > that's > not debatable.. Levels of paranoia make me wonder about this email username you're using. > Can't I just need to somehow fix the 1st 74M, and then somehow magically the "just" and "somehow" are doing *heavy* lifting there. Anyway I have no more I can add so I'm ducking out of this thread.
Re: accidentally overwritten wrong drive with DD, please help
On Thu, 27 Jun 2024 16:02:36 +0100, Anon Loli wrote: > > I'm not using anything commercial OR proprietary > [...] > > No one is getting any image or file or anything from me, and I'm not sending > my > drives to anyone. This might sound rude or stupid to you, I'm sorry, but > that's > not debatable.. > Well, when you're on you own. I really doubt that many software supports OpenBSD FS. > It sure does sound like a hobby for a while! > > Can't I just need to somehow fix the 1st 74M, and then somehow magically the > FFS sd3i magically is alive again, mountable and ridable? (get the > double-meaning? > xD) > I'm wondering how filesystems and how FFS2 works, and if maybe the 74M can be > somewhat easily fixable, like do filesystems keep an index of files and I > overwrote 74M of that index, or something like that? > "something like that", indeed. At begining FS, far less that the first 74M, it has the header and some structures that defines trees and other things like file names. Can you recreate it? Perhabs. -- wbr, Kirill
Re: accidentally overwritten wrong drive with DD, please help
On Thu, Jun 27, 2024 at 01:12:05PM +0100, Kirill A. Korinsky wrote: > On Thu, 27 Jun 2024 05:12:57 +0100, > Anon Loli wrote: > > > > But the steps that I already took is good, right? Is my corrupt data backed > > up > > at least? I need the raw disc copy, not the sd3i copy, right? Should I copy > > both? I have space > > > > Made as many copy of different things as you can. Better to make useless > copy here now than miss something and understand it when no return. Good point, I have plenty of space right now on the backup HDD > > > > why is everyone recommending rsync then? > > > > Personally, I understand your emails at some point like you had FS with > files mounted. Probably not only I had understand it that way. > > > > > No kidding? The 1st few people made it sound like it's going to be > > relatively > > easy :( > > > > Depends on your luck. > > Right now we have some comercial and open-source software which may support > OpenBSD FS, or may simple make a search in data to get some files. I'm not using anything commercial OR proprietary > Anyway, this isn't easy and fast task. > > If you really need your data I suggest to contact a few companies which > recover data, explain to them that had happened and provide to them your > images. > > Different tools may find different files, or different part of the same file > :) and after that you need to recombinided it into your real files. > > Sounds like a hobby for a while, isn't it? > > -- > wbr, Kirill No one is getting any image or file or anything from me, and I'm not sending my drives to anyone. This might sound rude or stupid to you, I'm sorry, but that's not debatable.. It sure does sound like a hobby for a while! Can't I just need to somehow fix the 1st 74M, and then somehow magically the FFS sd3i magically is alive again, mountable and ridable? (get the double-meaning? xD) I'm wondering how filesystems and how FFS2 works, and if maybe the 74M can be somewhat easily fixable, like do filesystems keep an index of files and I overwrote 74M of that index, or something like that? P.S. I just tried backing up sd3i (non-raw device), and it says "Device busy", so I guess nothing from that..
Re: accidentally overwritten wrong drive with DD, please help
On Thu, 27 Jun 2024 05:12:57 +0100, Anon Loli wrote: > > But the steps that I already took is good, right? Is my corrupt data backed up > at least? I need the raw disc copy, not the sd3i copy, right? Should I copy > both? I have space > Made as many copy of different things as you can. Better to make useless copy here now than miss something and understand it when no return. > > why is everyone recommending rsync then? > Personally, I understand your emails at some point like you had FS with files mounted. Probably not only I had understand it that way. > > No kidding? The 1st few people made it sound like it's going to be relatively > easy :( > Depends on your luck. Right now we have some comercial and open-source software which may support OpenBSD FS, or may simple make a search in data to get some files. Anyway, this isn't easy and fast task. If you really need your data I suggest to contact a few companies which recover data, explain to them that had happened and provide to them your images. Different tools may find different files, or different part of the same file :) and after that you need to recombinided it into your real files. Sounds like a hobby for a while, isn't it? -- wbr, Kirill
Re: accidentally overwritten wrong drive with DD, please help
On Wed, Jun 26, 2024 at 11:34:02PM -0400, Steve Litt wrote: > Anon Loli said on Wed, 26 Jun 2024 16:17:35 + > > > > >Why can't I just have another drive(encrypted of course), and do > >`dd if=/dev/rsd3i of=/mnt/hdd/brokenFSimage bs=1m` > > That's an excellent first step. Just make sure you get the destination > right so nothing else gets borked. ._. > But wait. Unless that "other drive" is somehow hotpluggable (like USB), > you'll need to shut down the computer to plug it in, and it's way too > soon in this process to turn off that computer. Why? I have it plugged in already and I've successfully not only DDd to the backup drive, but also verified that the data on both SSD and the backup HDD is the same sha512 hash, even if there's a 19G difference in size > >the /mnt/hdd is the mountpoint of the crypto volume of the secondary > >disk, and then somehow reformat the sd2/3 (the SSD with the corrupted > >FS), and then copy over the corrupted image backup from the HDD? > > The backup from your dd command isn't reliable, because garbage in > garbage out. dd makes a byte for byte copy --- it doesn't heal anything. But the steps that I already took is good, right? Is my corrupt data backed up at least? I need the raw disc copy, not the sd3i copy, right? Should I copy both? I have space > >(I got the adapter now, over the network it'd take many days, not > >counting broken pipes and what-not > > 200GB, many days? What are you dealing with, 10Mbit? > > > > >I didn't understand 100% of what you wrote, but if I understand > >correctly this is the simpler version of what you recommended, yes? > >(no idea what ddrescue is compared to dd) > > ddrescue helps with iffy disk sectors. why is everyone recommending rsync then? > >In that case the worst problem then would be how to get a functioning > >filesystem out of that image of the corrupted system? (assuming the > >raw disk of the crypto volume is the image of the filesystem, should > >be) > > I thought you currently have a mount of this partition that's > unencrypted. That's sure what it sounded like you said. If so, for gosh > sakes, copy all those files somewhere safe before turning off the > computer. I do, it's on /mnt/ssd, but it says no such directory even though `df -h` says otherwise > >Or you people keep on saying something like "do this and this and then > >backup/save files and directories", but I can't do that if I can't > >read the files directly, so how to do it indirectly? > > It sounded like you were saying you have a mount with an unencrypted > version of the files. If not, please forget the step I mentioned about > rsyncing the files somewhere else. I do > >I copied the image with the above command to the backup drive, what > >worries me is the following size on respective disks: > >primary disk (SSD with the corrupted crypto volume filesystem): used > >220G secondary disk (the backup HDD): used 239G > > I hope the capacity of that backup disk is more than 239GB, because > that would be cutting it pretty tight. Maybe you had 19GB of stuff on > the backup drive before doing this operation? > > > > >Why is the size like 19G difference? Does it have something to do with > >me DDing over the 1st 74M of the primary disk? > > OK, here I'm not understanding you at all. data on original disk SSD - is 220G data on the backup HDD that I just DDd and VERIFIED - is 239G how can there be a 19G difference in a same file (DDd image or whatever it's called), and still be the same hash? > And one more thing: That "backup disk", I hope it contains no files you > need for either data or the OS. I said it before and I'll say it again: > Go to the nearest computer store and buy a 1TB to 2TB USB interfaced > hard disk. > > >By the way it might be my imagination, but I think that the primary > >USED size was bigger like 24 hours ago (more than 220G), but I might > >just be seeing things > > > ? > > By the way, you'll still have a challenge restoring the files from the > encrypted device image of the borked drive. > > > SteveT > > Steve Litt > > http://444domains.com > No kidding? The 1st few people made it sound like it's going to be relatively easy :(
Re: accidentally overwritten wrong drive with DD, please help
Anon Loli said on Wed, 26 Jun 2024 16:41:14 + >(addition to my last reply) > >Also what do you mean borken machine? My machine isn't broken, it's >just that I DDd about 74M of /dev/urandom to rsd3i which is the >primary disk for storage, the SSD That's all I meant, the machine with the borked disk, to distinguish it from the machine that was going to be the destination of your emergency backup. >(and when I say primary it's not the disk with the OS) You spoke of a secondary disk in your last email, as a backup destination. I hope to hell you're not thinking of copying to the disk with your OS on it. > >2nd thing is what do you mean by copy files, like I said the >filesystem is unstable/corrupted a little(or something like that), and >ddrescue doesn't seem to be capable of assisting here in this regard > >So I think that the main problem is how to extract files/fix the >filesystem from that rsd3i image that I have backed up now? Yes, that will be a savage problem. I don't know where on the disk the 73GB got copied, so I can't be any help there. > also is it >safe to format the primary disk (ssd) now? No. Nobody can perfectly reverse engineer your situation and nobody has a crystal ball. I'd leave that SSD intact, stored outside the machine, for a year. Once you format it you can never again go back and query it. >as I said the size is >different after I DDd to the HDD, it's much bigger than the corrupted >image... and I don't think that I can do a hash-sum of the image, can >I? WTF I think I can do a "sha512 /dev/rsd3i" xD cool >I hope the raw device is what I needed, someone said that... but isn't >the non-raw (aka sd3i) where the plain old files are? But I'm still >confused as to why I can't view the rest of the sd3i, even though I >overwrote only a little big... I don't know how FFS works or >filesystems in general how they work, I know that boot drives need >certain space for certain OSs, for example for MBR/GBT or whatever >it's called, and stuff I knew more about this when I was excercising >Arch Linux, but what you don't use you forget with time, I think The preceding paragraph consists of questions I can't begin to answer, nor do I think they're very important. Get the disk image, as a file that can be loop-mounted, on at least one known good drive, and go on from there. Keep that borked DVD in a box somewhere for the next year when you finally power down the machine. SteveT Steve Litt http://444domains.com
Re: accidentally overwritten wrong drive with DD, please help
Anon Loli said on Wed, 26 Jun 2024 16:17:35 + >Why can't I just have another drive(encrypted of course), and do >`dd if=/dev/rsd3i of=/mnt/hdd/brokenFSimage bs=1m` That's an excellent first step. Just make sure you get the destination right so nothing else gets borked. But wait. Unless that "other drive" is somehow hotpluggable (like USB), you'll need to shut down the computer to plug it in, and it's way too soon in this process to turn off that computer. > >the /mnt/hdd is the mountpoint of the crypto volume of the secondary >disk, and then somehow reformat the sd2/3 (the SSD with the corrupted >FS), and then copy over the corrupted image backup from the HDD? The backup from your dd command isn't reliable, because garbage in garbage out. dd makes a byte for byte copy --- it doesn't heal anything. >(I got the adapter now, over the network it'd take many days, not >counting broken pipes and what-not 200GB, many days? What are you dealing with, 10Mbit? > >I didn't understand 100% of what you wrote, but if I understand >correctly this is the simpler version of what you recommended, yes? >(no idea what ddrescue is compared to dd) ddrescue helps with iffy disk sectors. >In that case the worst problem then would be how to get a functioning >filesystem out of that image of the corrupted system? (assuming the >raw disk of the crypto volume is the image of the filesystem, should >be) I thought you currently have a mount of this partition that's unencrypted. That's sure what it sounded like you said. If so, for gosh sakes, copy all those files somewhere safe before turning off the computer. > >Or you people keep on saying something like "do this and this and then >backup/save files and directories", but I can't do that if I can't >read the files directly, so how to do it indirectly? It sounded like you were saying you have a mount with an unencrypted version of the files. If not, please forget the step I mentioned about rsyncing the files somewhere else. >I copied the image with the above command to the backup drive, what >worries me is the following size on respective disks: >primary disk (SSD with the corrupted crypto volume filesystem): used >220G secondary disk (the backup HDD): used 239G I hope the capacity of that backup disk is more than 239GB, because that would be cutting it pretty tight. Maybe you had 19GB of stuff on the backup drive before doing this operation? > >Why is the size like 19G difference? Does it have something to do with >me DDing over the 1st 74M of the primary disk? OK, here I'm not understanding you at all. And one more thing: That "backup disk", I hope it contains no files you need for either data or the OS. I said it before and I'll say it again: Go to the nearest computer store and buy a 1TB to 2TB USB interfaced hard disk. >By the way it might be my imagination, but I think that the primary >USED size was bigger like 24 hours ago (more than 220G), but I might >just be seeing things ? By the way, you'll still have a challenge restoring the files from the encrypted device image of the borked drive. SteveT Steve Litt http://444domains.com
Re: accidentally overwritten wrong drive with DD, please help
This hasn't necessarily been explained very simply up to this point, so I'll give it a go. You are not going to be attempting to rebuild the filesystem or in any way make it functional. This is a key point to understand; the filesystem is done. Permanently broken. This is also the reason people keep saying don't put the image on another encrypted drive; you're going to need to access it using software designed to rescue files from broken filesystems. Some of the open-source stuff may run on OpenBSD. Or it may not. The commercial offerings absolutely will not. The only operating system that supports OpenBSD's full disk encryption _is_ OpenBSD, so by putting this on an encrypted disk, you immediately rule out access from a different OS. You'll also likely be spending a lot of time with a hex editor to recover anything specific that isn't recognized by heuristics. An option that hasn't been brought up yet is to take the _unencrypted_ disk image to a specialist in drive recovery who will already have the tools, resources, and knowledge to achieve as much as is possible at this point. As for using rsync and copying files/directories, if there is a separate untouched partition, or a partition that is mounted and possibly still has things cached, copy all you can using rsync while it's still mounted.
Re: accidentally overwritten wrong drive with DD, please help
(addition to my last reply) Also what do you mean borken machine? My machine isn't broken, it's just that I DDd about 74M of /dev/urandom to rsd3i which is the primary disk for storage, the SSD (and when I say primary it's not the disk with the OS) 2nd thing is what do you mean by copy files, like I said the filesystem is unstable/corrupted a little(or something like that), and ddrescue doesn't seem to be capable of assisting here in this regard So I think that the main problem is how to extract files/fix the filesystem from that rsd3i image that I have backed up now? also is it safe to format the primary disk (ssd) now? as I said the size is different after I DDd to the HDD, it's much bigger than the corrupted image... and I don't think that I can do a hash-sum of the image, can I? WTF I think I can do a "sha512 /dev/rsd3i" xD cool I hope the raw device is what I needed, someone said that... but isn't the non-raw (aka sd3i) where the plain old files are? But I'm still confused as to why I can't view the rest of the sd3i, even though I overwrote only a little big... I don't know how FFS works or filesystems in general how they work, I know that boot drives need certain space for certain OSs, for example for MBR/GBT or whatever it's called, and stuff I knew more about this when I was excercising Arch Linux, but what you don't use you forget with time, I think On Wed, Jun 26, 2024 at 04:17:35PM +, Anon Loli wrote: > On Tue, Jun 25, 2024 at 03:05:08AM -0400, Steve Litt wrote: > > Anon Loli said on Mon, 24 Jun 2024 18:29:52 + > > > > > > >I don't understand what's so complicated about DD, > > > > dd isn't complicated. ddrescue is even better. However, you mentioned > > you have a decrypted partition on your computer, and transferring that > > is better done with rsync than dd or ddrescue. > > > > >ssh/scp or > > > > DNS, routing, firewalling, all while you're under pressure. > > > > >encryption? > > > > Isn't encryption part of what got you into this situation in the first > > place? It's a massive complication when 99% of your priority is > > recovery. And why do you worry about data security on these USB disks > > (not sticks, disks) when they're only temporary? > > > > >I'll have to find my USB adapter, > > > > A new USB adapter will cost you what, forty bucks? What are your > > priorities here? How much do you value your data? > > > > >this is going too slow > > > > Not if it's USB3. I think 200GB would take less than an hour. > > > > >over the network, > > > > If your network is 1 Gbit, it makes no material difference. If it's > > 100Mbit, it's still not going to turn into a big problem. > > > > >that being said, I think that I mentioned the source > > >drive being over 200GB in size, so why mention USB sticks? lol > > > > LOL, I said USB disks, not sticks. > > > > https://www.newegg.com/model-wdbu6y0020bbk-wesn-2tb/p/1E8-0006-00101 > > > > Three of those cost you three less than $300, and each one holds ten > > times your 200GB of data. > > > > > > > >Encryption is a must, it's not just family photos, but even if it was, > > >I'm still not putting them on clear disk > > > > Well, if that's the hill you're willing to die on. > > > > Did I mention these intermediate disks are temporary, for the purpose > > of recovering you data, and they can be wiped later? Maybe this data > > isn't important enough to reduce the risk of mistakes in encryption? > > > > > > > >Now if you can't answer this that's fine, maybe someone else can.. if > > >I they can't then I'll cry > > >Question is: > > >if I write to the raw crypto volume (the decrypted disk), everything > > >should still be encrypted, right? > > > > Am I understanding that you want to write to the borked disk? Whatever > > the theory of it not hurting things (on a non-injured disk, of course), > > if you value your data I'd not touch the disk in question. > > > > >I don't understand exactly how under > > >the hood OpenBSD FDE works, > > > > Another excellent reason to make this thing as easy and simple as > > possible. > > > > but if I understand correctly, anything > > >written to the crypto volume gets encrypted and what-not, and then > > >stored to the drive encrypted, right? > > > > Whatever the answer is in theory, you're dealing with a disk injured in > > a way that's not describable on a mailing list > > > > > > > >I need to make a filesystem out of the backed-up copy if I understand > > >correctly, will it still work if 74M of it is overwritten? > > >Because then I could maybe DD over the raw(/non-raw?) crypto volume > > >and it should work? > > >Like what use is backing it up now and then making the filesystem on > > >the same drive and fucking up that entire drive? > > > > If you value your data, and please remember that unless you have > > your borked computer plugged into a known good uninterruptable power > > supply that can last longer than your longest power outages, you're > > one power outage a
Re: accidentally overwritten wrong drive with DD, please help
On Tue, Jun 25, 2024 at 03:05:08AM -0400, Steve Litt wrote: > Anon Loli said on Mon, 24 Jun 2024 18:29:52 + > > > >I don't understand what's so complicated about DD, > > dd isn't complicated. ddrescue is even better. However, you mentioned > you have a decrypted partition on your computer, and transferring that > is better done with rsync than dd or ddrescue. > > >ssh/scp or > > DNS, routing, firewalling, all while you're under pressure. > > >encryption? > > Isn't encryption part of what got you into this situation in the first > place? It's a massive complication when 99% of your priority is > recovery. And why do you worry about data security on these USB disks > (not sticks, disks) when they're only temporary? > > >I'll have to find my USB adapter, > > A new USB adapter will cost you what, forty bucks? What are your > priorities here? How much do you value your data? > > >this is going too slow > > Not if it's USB3. I think 200GB would take less than an hour. > > >over the network, > > If your network is 1 Gbit, it makes no material difference. If it's > 100Mbit, it's still not going to turn into a big problem. > > >that being said, I think that I mentioned the source > >drive being over 200GB in size, so why mention USB sticks? lol > > LOL, I said USB disks, not sticks. > > https://www.newegg.com/model-wdbu6y0020bbk-wesn-2tb/p/1E8-0006-00101 > > Three of those cost you three less than $300, and each one holds ten > times your 200GB of data. > > > > >Encryption is a must, it's not just family photos, but even if it was, > >I'm still not putting them on clear disk > > Well, if that's the hill you're willing to die on. > > Did I mention these intermediate disks are temporary, for the purpose > of recovering you data, and they can be wiped later? Maybe this data > isn't important enough to reduce the risk of mistakes in encryption? > > > > >Now if you can't answer this that's fine, maybe someone else can.. if > >I they can't then I'll cry > >Question is: > >if I write to the raw crypto volume (the decrypted disk), everything > >should still be encrypted, right? > > Am I understanding that you want to write to the borked disk? Whatever > the theory of it not hurting things (on a non-injured disk, of course), > if you value your data I'd not touch the disk in question. > > >I don't understand exactly how under > >the hood OpenBSD FDE works, > > Another excellent reason to make this thing as easy and simple as > possible. > > but if I understand correctly, anything > >written to the crypto volume gets encrypted and what-not, and then > >stored to the drive encrypted, right? > > Whatever the answer is in theory, you're dealing with a disk injured in > a way that's not describable on a mailing list > > > > >I need to make a filesystem out of the backed-up copy if I understand > >correctly, will it still work if 74M of it is overwritten? > >Because then I could maybe DD over the raw(/non-raw?) crypto volume > >and it should work? > >Like what use is backing it up now and then making the filesystem on > >the same drive and fucking up that entire drive? > > If you value your data, and please remember that unless you have > your borked computer plugged into a known good uninterruptable power > supply that can last longer than your longest power outages, you're > one power outage away from losing your data forever, so time is of > the essence. Here is the procedure I would personally use to get the > whole thing done *today*: > > 1. Go to the store and buy two usb3 spinning rust disks between 1TB and >2TB. I'd also buy a 7200 RPM SATA drive to act as your final >*encrypted* disk, or perhaps an SSD or NVMe of the same size. > > 2. Format and partition both of the USB disks. I highly suggest you not >encrypt them, because mistakes happen and things go wrong. > > 3. Use rsync to copy the unencrypted part to a tree on one of the USB >disks. Be sure to unmount it before unplugging it. Now at least you >have that. > > 4. Use ddrescue to whole device copy the borked device to a file on the >other spinning rust USB drive. Be sure to unmount it before >unplugging it. > > 5. USB3 copy both those drives to the computer you intended to copy them >to over the network. Be careful to copy the to the correct mount or >loop mount, because you don't want to bork a second computer. > > 6. Back up the computer you just copied to. The backup can be >encrypted. Just be careful to remember the decryption key and > > 6. Do whatever you can to rescue any data you haven't already rescued >from the borked disk. > > 7. Power down the machine with the borked disk, remove the borked disk, >and keep it for a year in case you need it. > > 8. Install your new SATA disk in the formerly borked machine, format >and encrypt it (remember the key or password). > > 9. Copy your old data onto the newly installed, formatted and encrypted >hard drive. >
Re: accidentally overwritten wrong drive with DD, please help
On 6/25/24 09:07, Kirill A. Korinsky wrote: On Tue, 25 Jun 2024 04:05:45 +0100, "B. Atticus Grobe" wrote: A word of warning: even multiple overwrites are not guaranteed to erase any kind of flash-based storage. This applies even to some spinning rust now that have intermediate flash storage caches on them (although those tend to be enterprise-level devices). SSD/NVME's made by a reputable manufacturer usually have a secure delete function, but there are cases where this doesn't work, or doesn't work entirely, etc. This is a very interesting point, thank you. Do you know any kind of behavior for TRIM? So, literally, here no way to secure remove data from SSD/NVME. Some drives support the command "data security erase". The run time can be very long.
Re: accidentally overwritten wrong drive with DD, please help
On Tue, 25 Jun 2024 04:05:45 +0100, "B. Atticus Grobe" wrote: > > A word of warning: even multiple overwrites are not guaranteed to erase any > kind > of flash-based storage. This applies even to some spinning rust now that have > intermediate flash storage caches on them (although those tend to be > enterprise-level devices). > > SSD/NVME's made by a reputable manufacturer usually have a secure delete > function, > but there are cases where this doesn't work, or doesn't work entirely, etc. > This is a very interesting point, thank you. Do you know any kind of behavior for TRIM? So, literally, here no way to secure remove data from SSD/NVME. -- wbr, Kirill
Re: accidentally overwritten wrong drive with DD, please help
> > > > You may fill your disk, after you recover everything with random data. > > Couple of times. It removes everything. > will it destroy the filesystem as well?
Re: accidentally overwritten wrong drive with DD, please help
On 2024-06-25, Steve Litt wrote: > Stuart Henderson said on Mon, 24 Jun 2024 22:35:59 - (UTC) > >>Turning it directly into a working filesystem is probably not going to >>happen. > > If I read and understood him correctly, right now he has the encrypted > drive open as unencrypted, giving him a chance to just rsync that data > off the computer. Now those files might be compromised, but it's an > excellent start. If I understood correctly. The softraid device is attached but IIUC the filesystem on that device is broken and not mountable.
Re: accidentally overwritten wrong drive with DD, please help
Anon Loli said on Mon, 24 Jun 2024 18:29:52 + >I don't understand what's so complicated about DD, dd isn't complicated. ddrescue is even better. However, you mentioned you have a decrypted partition on your computer, and transferring that is better done with rsync than dd or ddrescue. >ssh/scp or DNS, routing, firewalling, all while you're under pressure. >encryption? Isn't encryption part of what got you into this situation in the first place? It's a massive complication when 99% of your priority is recovery. And why do you worry about data security on these USB disks (not sticks, disks) when they're only temporary? >I'll have to find my USB adapter, A new USB adapter will cost you what, forty bucks? What are your priorities here? How much do you value your data? >this is going too slow Not if it's USB3. I think 200GB would take less than an hour. >over the network, If your network is 1 Gbit, it makes no material difference. If it's 100Mbit, it's still not going to turn into a big problem. >that being said, I think that I mentioned the source >drive being over 200GB in size, so why mention USB sticks? lol LOL, I said USB disks, not sticks. https://www.newegg.com/model-wdbu6y0020bbk-wesn-2tb/p/1E8-0006-00101 Three of those cost you three less than $300, and each one holds ten times your 200GB of data. > >Encryption is a must, it's not just family photos, but even if it was, >I'm still not putting them on clear disk Well, if that's the hill you're willing to die on. Did I mention these intermediate disks are temporary, for the purpose of recovering you data, and they can be wiped later? Maybe this data isn't important enough to reduce the risk of mistakes in encryption? > >Now if you can't answer this that's fine, maybe someone else can.. if >I they can't then I'll cry >Question is: >if I write to the raw crypto volume (the decrypted disk), everything >should still be encrypted, right? Am I understanding that you want to write to the borked disk? Whatever the theory of it not hurting things (on a non-injured disk, of course), if you value your data I'd not touch the disk in question. >I don't understand exactly how under >the hood OpenBSD FDE works, Another excellent reason to make this thing as easy and simple as possible. but if I understand correctly, anything >written to the crypto volume gets encrypted and what-not, and then >stored to the drive encrypted, right? Whatever the answer is in theory, you're dealing with a disk injured in a way that's not describable on a mailing list > >I need to make a filesystem out of the backed-up copy if I understand >correctly, will it still work if 74M of it is overwritten? >Because then I could maybe DD over the raw(/non-raw?) crypto volume >and it should work? >Like what use is backing it up now and then making the filesystem on >the same drive and fucking up that entire drive? If you value your data, and please remember that unless you have your borked computer plugged into a known good uninterruptable power supply that can last longer than your longest power outages, you're one power outage away from losing your data forever, so time is of the essence. Here is the procedure I would personally use to get the whole thing done *today*: 1. Go to the store and buy two usb3 spinning rust disks between 1TB and 2TB. I'd also buy a 7200 RPM SATA drive to act as your final *encrypted* disk, or perhaps an SSD or NVMe of the same size. 2. Format and partition both of the USB disks. I highly suggest you not encrypt them, because mistakes happen and things go wrong. 3. Use rsync to copy the unencrypted part to a tree on one of the USB disks. Be sure to unmount it before unplugging it. Now at least you have that. 4. Use ddrescue to whole device copy the borked device to a file on the other spinning rust USB drive. Be sure to unmount it before unplugging it. 5. USB3 copy both those drives to the computer you intended to copy them to over the network. Be careful to copy the to the correct mount or loop mount, because you don't want to bork a second computer. 6. Back up the computer you just copied to. The backup can be encrypted. Just be careful to remember the decryption key and 6. Do whatever you can to rescue any data you haven't already rescued from the borked disk. 7. Power down the machine with the borked disk, remove the borked disk, and keep it for a year in case you need it. 8. Install your new SATA disk in the formerly borked machine, format and encrypt it (remember the key or password). 9. Copy your old data onto the newly installed, formatted and encrypted hard drive. 10. Wipe and reformat and encrypt your USB drive with the directory tree (not the drive image). 11. Rsync your new SATA drive's files and directories that USB drive, which becomes your backup preventing another disaster. 12. Take regular backups so this doesn't happen again. The preceding procedure sho
Re: accidentally overwritten wrong drive with DD, please help
A word of warning: even multiple overwrites are not guaranteed to erase any kind of flash-based storage. This applies even to some spinning rust now that have intermediate flash storage caches on them (although those tend to be enterprise-level devices). SSD/NVME's made by a reputable manufacturer usually have a secure delete function, but there are cases where this doesn't work, or doesn't work entirely, etc.
Re: accidentally overwritten wrong drive with DD, please help
On 2024-06-24, Anon Loli wrote: > On Mon, Jun 24, 2024 at 07:36:57AM -0400, Steve Litt wrote: >> Anon Loli said on Sun, 23 Jun 2024 12:19:15 + >> >> >> >Okay, I've enabled the drive now, how do I approach this? >> >I want the drive that's receiving the data copy to be encrypted, and >> >> Encrypted? Man, you're getting too complicated for the situation. >> Priorities. Task 1 is to copy over the borked drive to a USB drive so >> you have a stable "go back to" point. Task 2 is to have a second drive >> to experiment on, safe in the knowledge that you can always restore >> from the copy from task 1. Encryption just makes it more likely you'll >> bork things again. >> >> >it'll have to be over ssh, so I'm assuming some combination of DD and >> >SCP? >> >> SSH and SCP? Say what? How bout a USB3 rotating drive? And NOT a >> Seagate. >> >> > >> >I've looked on the internet now, and it seems like dump/restore are >> >perfect for this (and even faster than dd?) >> >So maybe something like >> >`dump af /dev/sd3i | ssh receiving-computer "restore xf -"` >> >But where would the sd3i end up then and how? would it turn in a file, >> >or become a /dev/sd3i copy on the receiving computer? >> >If you don't respond, I'll search the internet and try to do it on my >> >own (for the 1st time) and possibly overwrite something again lol >> > >> >Would be great if I could find some great read about this >> > >> >> Personally, I think you're making this much harder than it has to be. >> If you care about those old photos, spend the money for enough USB hard >> drives, and don't get fancy until you have a copy of your files AND a >> backup of the copy of those files. Then you can treat the copy like a >> backup and copy them back. >> >> Seriously, priorities. Prioritize getting those files back, and don't >> let anything complicate that task. Don't skip steps. >> >> SteveT >> >> Steve Litt >> >> http://444domains.com >> > > I don't understand what's so complicated about DD, ssh/scp or encryption? > I'll have to find my USB adapter, this is going too slow over the network, > that > being said, I think that I mentioned the source drive being over 200GB in > size, > so why mention USB sticks? lol USB drive != "USB stick" (not that 200GB is much for a USB stick these days). (use bs=1m on the writing side to write in larger chunks if you're dd'ing to flash media or SMR HDD). > Encryption is a must, it's not just family photos, but even if it was, I'm > still not putting them on clear disk If you don't trust the machine you're attaching it to, you're screwed anyway. And some of the tools that might be able to help with recovery won't be much help with a softraid-encrypted disk. > I need to make a filesystem out of the backed-up copy if I understand > correctly, Turning it directly into a working filesystem is probably not going to happen. You need to try to extract what bits of data are still recoverable. Think more in terms of trying to find what valid files you can and copying them elsewhere. > Like what use is backing it up now and then making the filesystem on the same > drive and fucking up that entire drive? Yeah, you want to treat that copy as read-only, the same way you'd treat any drive you're trying to recover data from as read-only. If you're going to try and write anything to it, you'll then want _another_ copy to work on. -- Please keep replies on the mailing list.
Re: accidentally overwritten wrong drive with DD, please help
On Mon, 24 Jun 2024 19:29:52 +0100, Anon Loli wrote: > > Encryption is a must, it's not just family photos, but even if it was, I'm > still not putting them on clear disk > You may fill your disk, after you recover everything with random data. Couple of times. It removes everything. -- wbr, Kirill
Re: accidentally overwritten wrong drive with DD, please help
On Mon, Jun 24, 2024 at 12:34 PM Anon Loli wrote: > ... > Like what use is backing it up now and then making the filesystem on the > same > drive and fucking up that entire drive? > > backup now is so you can make different tests and still have somewhere to come back anything you do can further destroy the data
Re: accidentally overwritten wrong drive with DD, please help
On Mon, Jun 24, 2024 at 07:36:57AM -0400, Steve Litt wrote: > Anon Loli said on Sun, 23 Jun 2024 12:19:15 + > > > >Okay, I've enabled the drive now, how do I approach this? > >I want the drive that's receiving the data copy to be encrypted, and > > Encrypted? Man, you're getting too complicated for the situation. > Priorities. Task 1 is to copy over the borked drive to a USB drive so > you have a stable "go back to" point. Task 2 is to have a second drive > to experiment on, safe in the knowledge that you can always restore > from the copy from task 1. Encryption just makes it more likely you'll > bork things again. > > >it'll have to be over ssh, so I'm assuming some combination of DD and > >SCP? > > SSH and SCP? Say what? How bout a USB3 rotating drive? And NOT a > Seagate. > > > > >I've looked on the internet now, and it seems like dump/restore are > >perfect for this (and even faster than dd?) > >So maybe something like > >`dump af /dev/sd3i | ssh receiving-computer "restore xf -"` > >But where would the sd3i end up then and how? would it turn in a file, > >or become a /dev/sd3i copy on the receiving computer? > >If you don't respond, I'll search the internet and try to do it on my > >own (for the 1st time) and possibly overwrite something again lol > > > >Would be great if I could find some great read about this > > > > Personally, I think you're making this much harder than it has to be. > If you care about those old photos, spend the money for enough USB hard > drives, and don't get fancy until you have a copy of your files AND a > backup of the copy of those files. Then you can treat the copy like a > backup and copy them back. > > Seriously, priorities. Prioritize getting those files back, and don't > let anything complicate that task. Don't skip steps. > > SteveT > > Steve Litt > > http://444domains.com > I don't understand what's so complicated about DD, ssh/scp or encryption? I'll have to find my USB adapter, this is going too slow over the network, that being said, I think that I mentioned the source drive being over 200GB in size, so why mention USB sticks? lol Encryption is a must, it's not just family photos, but even if it was, I'm still not putting them on clear disk Now if you can't answer this that's fine, maybe someone else can.. if I they can't then I'll cry Question is: if I write to the raw crypto volume (the decrypted disk), everything should still be encrypted, right? I don't understand exactly how under the hood OpenBSD FDE works, but if I understand correctly, anything written to the crypto volume gets encrypted and what-not, and then stored to the drive encrypted, right? I need to make a filesystem out of the backed-up copy if I understand correctly, will it still work if 74M of it is overwritten? Because then I could maybe DD over the raw(/non-raw?) crypto volume and it should work? Like what use is backing it up now and then making the filesystem on the same drive and fucking up that entire drive?
Re: accidentally overwritten wrong drive with DD, please help
Anon Loli said on Sun, 23 Jun 2024 12:19:15 + >Okay, I've enabled the drive now, how do I approach this? >I want the drive that's receiving the data copy to be encrypted, and Encrypted? Man, you're getting too complicated for the situation. Priorities. Task 1 is to copy over the borked drive to a USB drive so you have a stable "go back to" point. Task 2 is to have a second drive to experiment on, safe in the knowledge that you can always restore from the copy from task 1. Encryption just makes it more likely you'll bork things again. >it'll have to be over ssh, so I'm assuming some combination of DD and >SCP? SSH and SCP? Say what? How bout a USB3 rotating drive? And NOT a Seagate. > >I've looked on the internet now, and it seems like dump/restore are >perfect for this (and even faster than dd?) >So maybe something like >`dump af /dev/sd3i | ssh receiving-computer "restore xf -"` >But where would the sd3i end up then and how? would it turn in a file, >or become a /dev/sd3i copy on the receiving computer? >If you don't respond, I'll search the internet and try to do it on my >own (for the 1st time) and possibly overwrite something again lol > >Would be great if I could find some great read about this > Personally, I think you're making this much harder than it has to be. If you care about those old photos, spend the money for enough USB hard drives, and don't get fancy until you have a copy of your files AND a backup of the copy of those files. Then you can treat the copy like a backup and copy them back. Seriously, priorities. Prioritize getting those files back, and don't let anything complicate that task. Don't skip steps. SteveT Steve Litt http://444domains.com
Re: accidentally overwritten wrong drive with DD, please help
Дана 24/06/23 10:28PM, Andy Bradford написа: > Once you have that, make another copy of it and start using whatever > tools you can to inspect the raw data to discover whether or not it is > likely that you'll be able to recover anything from it. (@OP:) If the data is that important (family photos, etc), learn to create backups of it, which, as situations like the one described show, is more important for valuable data than encryption, especially when one doesn't yet know the system well. Learn the system first, then go for advanced topics like encryption. If you had a backup to begin with, this wouldn't happen. I had my "just make backups" moment when I was still using DOS in the 90s, and tried to compress a hard disk with DoubleSpace (or was it DriveSpace?) without running chkdsk + defrag. Naturally, at X% the compression stopped and I was left with half of my files gone.
Re: accidentally overwritten wrong drive with DD, please help
Thus said Anon Loli on Sun, 23 Jun 2024 13:38:01 -: > On Sun, Jun 23, 2024 at 10:07:55AM -0300, Crystal Kolipe wrote: > > Seriously, forget it. > > What do you mean? What it means is that you are in disaster recovery mode and fancy commands are less likely to be successful than deliberate straight forward operations. That being said, if you cannot directly attach another USB drive to the system then you may have to resort to "fancy", but generally the simpler the better. Your immediate goal is to get a raw copy of the unencrypted partition (or entire disk) if possible. Once you have that, make another copy of it and start using whatever tools you can to inspect the raw data to discover whether or not it is likely that you'll be able to recover anything from it. Andy
Re: accidentally overwritten wrong drive with DD, please help
On Sun, Jun 23, 2024 at 08:17:55PM +, Anon Loli wrote: > What I'm worried about, though, is how do I use the copy on the destination > machine to make a filesystem out of it, and do it on an crypto volume of the > destination machine? As I already told you: On Sat, Jun 22, 2024 at 12:35:56PM -0300, Crystal Kolipe wrote: > In theory most of your data would be recoverable from that image, but it would > require a lot of work and knowledge of ffs filesystem layout. Saving an image of the, (decrypted), partition gives you the chance to recover some of the data at a later date, using whatever tools, expertise, or third party assistance you have available at the time.
Re: accidentally overwritten wrong drive with DD, please help
On Sun, Jun 23, 2024 at 04:22:12PM -0300, Crystal Kolipe wrote: > On Sun, Jun 23, 2024 at 07:03:36PM +, Anon Loli wrote: > > Okay, I now have a fresh big chunky encrypted drive on another machine and > > can > > transfer the image/files from the corrupted sd3i to it, but when I tried to > > run > > `dd if=/dev/sd3i | ssh destination "dd of=/mnt/somewhere/ssdimage bs=1m" > > or even to a regular file on the same machine, I got this: > > "dd: /dev/sd3i: Device busy" > > Because that partition is mounted. > > Since the system is potentially in an unstable state, I wouldn't try > unmounting it. > > Either use the character device rsd3i, or the whole disc 'c' partition. > > Also, once the image is copied over to the destination, check that it's more > or > less the expected size before finally resetting the source machine or doing > anything else to lose the key. > Okay, I'm not worried with the resetting of the source machine, it can run 24/7. What I'm worried about, though, is how do I use the copy on the destination machine to make a filesystem out of it, and do it on an crypto volume of the destination machine? Maybe makefs(8)? And what do I do with the missing 74M? do I truncate that from the copy on the destination machine? This must feel like when doctors do a surgery... I did similar stuff with FreeBSD's encrypted volume, but it was just the metadata that was deleted (that time it wasn't me that was the culprit but some program on another OS) and other stuff I forgot.. I like this, this is, I bet, how one learns stufff and remembers them because well they're traumatic :)
Re: accidentally overwritten wrong drive with DD, please help
On Sun, Jun 23, 2024 at 07:03:36PM +, Anon Loli wrote: > Okay, I now have a fresh big chunky encrypted drive on another machine and can > transfer the image/files from the corrupted sd3i to it, but when I tried to > run > `dd if=/dev/sd3i | ssh destination "dd of=/mnt/somewhere/ssdimage bs=1m" > or even to a regular file on the same machine, I got this: > "dd: /dev/sd3i: Device busy" Because that partition is mounted. Since the system is potentially in an unstable state, I wouldn't try unmounting it. Either use the character device rsd3i, or the whole disc 'c' partition. Also, once the image is copied over to the destination, check that it's more or less the expected size before finally resetting the source machine or doing anything else to lose the key.
Re: accidentally overwritten wrong drive with DD, please help
((( this is a reply to an older email because I think it's more relevant than older emails ))) On Sat, Jun 22, 2024 at 12:35:56PM -0300, Crystal Kolipe wrote: > On Sat, Jun 22, 2024 at 03:02:29PM +, Anon Loli wrote: > > On Sat, Jun 22, 2024 at 11:51:53AM -0300, Crystal Kolipe wrote: > > > On Sat, Jun 22, 2024 at 01:02:04PM +, Anon Loli wrote: > > > > Hello list > > > > So I was trying to resolve the problem that I just submitted with the > > > > Installer, and I was putting a fresh install75 on my USB, the problem > > > > is that > > > > last DD/flash my USB was on sd2, and in meanwhile I attached my VERY > > > > IMPORTANT > > > > external drive to my computer which became sd2 with crypto volume > > > > attached as > > > > sd3, so it was mounted. > > > > > > There is a difference between the crypto volume being _attached_ and a > > > partition on it being _mounted_. > > > > > > In your case the crypto volume contained within sd2 was attached as sd3. > > > > > > But quite possibly none of the partitions on sd3 was mounted on /mnt. > > > > > > Now you have overwritten the beginning of sd2, which is where the > > > encryption > > > keys are stored. > > > > > > But since it was hopefully already attached a copy of these keys will be > > > in > > > RAM, despite the fact that you have trashed the on-disk copy. > > > > > > So don't reset the machine now, because that copy would be lost. > > > > > > What happens if you do: > > > > > > # mount -oro /dev/sd3X /mnt > > > > > > Replacing X with the partition that you actually had on the external disk, > > > (probably a or d). > > > > > > Are you able to see anything that was on the disk? > > > > > > If so, let us know and don't do anything else that might crash the > > > machine. > > > > > > > I sent a reply with some more info, do you still want me to proceed with > > `mount -oro`? > > No, the partition is already mounted. > > I'm assuming that you only had this one partition on the encrypted volume sd3, > and that it started at or near the beginning of the disk. In the unlikely > event that you had multiple partitions on it, the second and subsequent ones > might still be mountable and intact. > > In the more likely case that it was one large partition at the beginning, then > the first ~70 Mb of sd3 have also been lost, because that data was backed by > the first ~70 Mb of sd2 that you overwrote. > > The one glimmer of hope that you have is that you are almost certainly still > reading the data on the rest of sd3, (past the first ~70 Mb), correctly > decrypted, because the key is in RAM, (but overwritten on the disk). > > If the data was genuinely valuable as you describe, you might want to attach > a new storage volume that is at least as big as sd3, and write an image of sd3 > to that volume whilst you still can, (because once you reset the machine or > detach the sd3 volume the key will be lost). > > In theory most of your data would be recoverable from that image, but it would > require a lot of work and knowledge of ffs filesystem layout. > > If you do make an image of the disk, you could try searching it for ASCII > strings and if you found any then it would confirm that the encrypted data was > correctly decrypted at the time of copying. > > Oh, and in the future it's much easier to make backups than to go through this > nightmare of data recovery. > Okay, I now have a fresh big chunky encrypted drive on another machine and can transfer the image/files from the corrupted sd3i to it, but when I tried to run `dd if=/dev/sd3i | ssh destination "dd of=/mnt/somewhere/ssdimage bs=1m" or even to a regular file on the same machine, I got this: "dd: /dev/sd3i: Device busy" What does this mean? Did I lose the key from RAM or something else? Did I lose my data forever? :(
Re: accidentally overwritten wrong drive with DD, please help
On Sun, Jun 23, 2024 at 10:07:55AM -0300, Crystal Kolipe wrote: > On Sun, Jun 23, 2024 at 12:19:15PM +, Anon Loli wrote: > > On Sun, Jun 23, 2024 at 11:56:18AM +, Anon Loli wrote: > > > On Sat, Jun 22, 2024 at 03:28:37PM -0300, Crystal Kolipe wrote: > > > > On Sat, Jun 22, 2024 at 06:03:06PM -, Stuart Henderson wrote: > > > > > If this is really important, I suggest going to buy another drive to > > > > > plug in and dd to rather than trying to do anything complicated. > > > > > > > > Definitely. If the only copy of the key is in RAM, then time is of the > > > > essence. > > > > > > I know.. I have a spare drive that I can enable if only I were to not > > > have a > > > problem with the computer detecting the drives (they aren't in /dev at > > > all, but > > > dmesg is reading them OK), as it is said in the other mailing thread > > > "Installer..." > > > > > > I'll get back to you guys after we fix that issue (if we do, otherwise > > > I'll > > > have to do a different approach to enabling the hard drive which would be > > > bad > > > becaues I want that drive to work as it is, in that computer) > > > > > > > Okay, I've enabled the drive now, how do I approach this? > > Connect an external USB storage device to the machine that has the disk that > you > overwrote, and use dd to copy the raw sd3c device to a file on that new disk. > > Anything more complicated than that is likely to be a waste of time, and could > prejudice your chances of copying the data elsewhere before you lose the > encryption > key. I can't have it as external, the simplest thing would be to copy it over the network, for me I could do that like this: `dd if=/dev/sd3i | ssh destination-computer "dd of=/tmp/sd3copy"` or even `dd if=/dev/sd3i | ssh destination-computer "dd of=/dev/sdXi"` where sdXi is the crypto volume of the destination-computer's receiving drive If you think this approach is okay, how do I proceed? If something like 2nd approach is not possible, then the 1st approach is like a filesystem written to a file? If so isn't there a tool to convert a file to a filesystem? Am I missing anything? > > I want the drive that's receiving the data copy to be encrypted, and it'll > > have > > to be over ssh, so I'm assuming some combination of DD and SCP? > > Forget it. > > > I've looked on the internet now, and it seems like dump/restore are perfect > > for > > this (and even faster than dd?) > > Seriously, forget it. > What do you mean?
Re: accidentally overwritten wrong drive with DD, please help
On Sun, Jun 23, 2024 at 12:19:15PM +, Anon Loli wrote: > On Sun, Jun 23, 2024 at 11:56:18AM +, Anon Loli wrote: > > On Sat, Jun 22, 2024 at 03:28:37PM -0300, Crystal Kolipe wrote: > > > On Sat, Jun 22, 2024 at 06:03:06PM -, Stuart Henderson wrote: > > > > If this is really important, I suggest going to buy another drive to > > > > plug in and dd to rather than trying to do anything complicated. > > > > > > Definitely. If the only copy of the key is in RAM, then time is of the > > > essence. > > > > I know.. I have a spare drive that I can enable if only I were to not have a > > problem with the computer detecting the drives (they aren't in /dev at all, > > but > > dmesg is reading them OK), as it is said in the other mailing thread > > "Installer..." > > > > I'll get back to you guys after we fix that issue (if we do, otherwise I'll > > have to do a different approach to enabling the hard drive which would be > > bad > > becaues I want that drive to work as it is, in that computer) > > > > Okay, I've enabled the drive now, how do I approach this? Connect an external USB storage device to the machine that has the disk that you overwrote, and use dd to copy the raw sd3c device to a file on that new disk. Anything more complicated than that is likely to be a waste of time, and could prejudice your chances of copying the data elsewhere before you lose the encryption key. > I want the drive that's receiving the data copy to be encrypted, and it'll > have > to be over ssh, so I'm assuming some combination of DD and SCP? Forget it. > I've looked on the internet now, and it seems like dump/restore are perfect > for > this (and even faster than dd?) Seriously, forget it.
Re: accidentally overwritten wrong drive with DD, please help
cd /dev && doas sh MAKEDEV sdX (or whatever the base device name is). man 8 MAKEDEV for more info on that On Sun, Jun 23, 2024 at 6:59 AM Anon Loli wrote: > ... > problem with the computer detecting the drives (they aren't in /dev at > all, but > dmesg is reading them OK), >
Re: accidentally overwritten wrong drive with DD, please help
On Sun, Jun 23, 2024 at 11:56:18AM +, Anon Loli wrote: > On Sat, Jun 22, 2024 at 03:28:37PM -0300, Crystal Kolipe wrote: > > On Sat, Jun 22, 2024 at 06:03:06PM -, Stuart Henderson wrote: > > > If this is really important, I suggest going to buy another drive to > > > plug in and dd to rather than trying to do anything complicated. > > > > Definitely. If the only copy of the key is in RAM, then time is of the > > essence. > > I know.. I have a spare drive that I can enable if only I were to not have a > problem with the computer detecting the drives (they aren't in /dev at all, > but > dmesg is reading them OK), as it is said in the other mailing thread > "Installer..." > > I'll get back to you guys after we fix that issue (if we do, otherwise I'll > have to do a different approach to enabling the hard drive which would be bad > becaues I want that drive to work as it is, in that computer) > Okay, I've enabled the drive now, how do I approach this? I want the drive that's receiving the data copy to be encrypted, and it'll have to be over ssh, so I'm assuming some combination of DD and SCP? I've looked on the internet now, and it seems like dump/restore are perfect for this (and even faster than dd?) So maybe something like `dump af /dev/sd3i | ssh receiving-computer "restore xf -"` But where would the sd3i end up then and how? would it turn in a file, or become a /dev/sd3i copy on the receiving computer? If you don't respond, I'll search the internet and try to do it on my own (for the 1st time) and possibly overwrite something again lol Would be great if I could find some great read about this
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 22, 2024 at 03:28:37PM -0300, Crystal Kolipe wrote: > On Sat, Jun 22, 2024 at 06:03:06PM -, Stuart Henderson wrote: > > If this is really important, I suggest going to buy another drive to > > plug in and dd to rather than trying to do anything complicated. > > Definitely. If the only copy of the key is in RAM, then time is of the > essence. I know.. I have a spare drive that I can enable if only I were to not have a problem with the computer detecting the drives (they aren't in /dev at all, but dmesg is reading them OK), as it is said in the other mailing thread "Installer..." I'll get back to you guys after we fix that issue (if we do, otherwise I'll have to do a different approach to enabling the hard drive which would be bad becaues I want that drive to work as it is, in that computer)
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 22, 2024 at 06:03:06PM -, Stuart Henderson wrote: > If this is really important, I suggest going to buy another drive to > plug in and dd to rather than trying to do anything complicated. Definitely. If the only copy of the key is in RAM, then time is of the essence.
Re: accidentally overwritten wrong drive with DD, please help
On 2024-06-22, Anon Loli wrote: > On Sat, Jun 22, 2024 at 12:35:56PM -0300, Crystal Kolipe wrote: >> >> In theory most of your data would be recoverable from that image, but it >> would >> require a lot of work and knowledge of ffs filesystem layout. At one point I had access to R-Studio for something else (Windows RAID recovery) and tried pointing it at slightly broken OpenBSD FFS while I was there to see how it went - much better than I thought it would - though it was pre FFS2 and I don't have access any more to check if it's still useful. Might possibly be worth a try (obviously with a copy not a live drive). > So what you're saying is that I need a new disk that's at least the size of > the > overwritten SSD, and then make an image of sd3 and copy it over to the new > disk? > I don't think that I have as you said enough knowledge about FFS... > > I can use the other computer that has enough storage space, but I can't > install > OpenBSD well, it's the other recent mail with "Installer" in name, if we solve > that, then I can install OpenBSD on there and gain access to a drive where I > can then copy over the image of sd3 over ssh then.. If this is really important, I suggest going to buy another drive to plug in and dd to rather than trying to do anything complicated. -- Please keep replies on the mailing list.
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 22, 2024 at 12:35:56PM -0300, Crystal Kolipe wrote: > On Sat, Jun 22, 2024 at 03:02:29PM +, Anon Loli wrote: > > On Sat, Jun 22, 2024 at 11:51:53AM -0300, Crystal Kolipe wrote: > > > On Sat, Jun 22, 2024 at 01:02:04PM +, Anon Loli wrote: > > > > Hello list > > > > So I was trying to resolve the problem that I just submitted with the > > > > Installer, and I was putting a fresh install75 on my USB, the problem > > > > is that > > > > last DD/flash my USB was on sd2, and in meanwhile I attached my VERY > > > > IMPORTANT > > > > external drive to my computer which became sd2 with crypto volume > > > > attached as > > > > sd3, so it was mounted. > > > > > > There is a difference between the crypto volume being _attached_ and a > > > partition on it being _mounted_. > > > > > > In your case the crypto volume contained within sd2 was attached as sd3. > > > > > > But quite possibly none of the partitions on sd3 was mounted on /mnt. > > > > > > Now you have overwritten the beginning of sd2, which is where the > > > encryption > > > keys are stored. > > > > > > But since it was hopefully already attached a copy of these keys will be > > > in > > > RAM, despite the fact that you have trashed the on-disk copy. > > > > > > So don't reset the machine now, because that copy would be lost. > > > > > > What happens if you do: > > > > > > # mount -oro /dev/sd3X /mnt > > > > > > Replacing X with the partition that you actually had on the external disk, > > > (probably a or d). > > > > > > Are you able to see anything that was on the disk? > > > > > > If so, let us know and don't do anything else that might crash the > > > machine. > > > > > > > I sent a reply with some more info, do you still want me to proceed with > > `mount -oro`? > > No, the partition is already mounted. > > I'm assuming that you only had this one partition on the encrypted volume sd3, > and that it started at or near the beginning of the disk. In the unlikely > event that you had multiple partitions on it, the second and subsequent ones > might still be mountable and intact. > > In the more likely case that it was one large partition at the beginning, then > the first ~70 Mb of sd3 have also been lost, because that data was backed by > the first ~70 Mb of sd2 that you overwrote. > > The one glimmer of hope that you have is that you are almost certainly still > reading the data on the rest of sd3, (past the first ~70 Mb), correctly > decrypted, because the key is in RAM, (but overwritten on the disk). > > If the data was genuinely valuable as you describe, you might want to attach > a new storage volume that is at least as big as sd3, and write an image of sd3 > to that volume whilst you still can, (because once you reset the machine or > detach the sd3 volume the key will be lost). > > In theory most of your data would be recoverable from that image, but it would > require a lot of work and knowledge of ffs filesystem layout. > > If you do make an image of the disk, you could try searching it for ASCII > strings and if you found any then it would confirm that the encrypted data was > correctly decrypted at the time of copying. > > Oh, and in the future it's much easier to make backups than to go through this > nightmare of data recovery. So what you're saying is that I need a new disk that's at least the size of the overwritten SSD, and then make an image of sd3 and copy it over to the new disk? I don't think that I have as you said enough knowledge about FFS... I can use the other computer that has enough storage space, but I can't install OpenBSD well, it's the other recent mail with "Installer" in name, if we solve that, then I can install OpenBSD on there and gain access to a drive where I can then copy over the image of sd3 over ssh then..
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 22, 2024 at 03:02:29PM +, Anon Loli wrote: > On Sat, Jun 22, 2024 at 11:51:53AM -0300, Crystal Kolipe wrote: > > On Sat, Jun 22, 2024 at 01:02:04PM +, Anon Loli wrote: > > > Hello list > > > So I was trying to resolve the problem that I just submitted with the > > > Installer, and I was putting a fresh install75 on my USB, the problem is > > > that > > > last DD/flash my USB was on sd2, and in meanwhile I attached my VERY > > > IMPORTANT > > > external drive to my computer which became sd2 with crypto volume > > > attached as > > > sd3, so it was mounted. > > > > There is a difference between the crypto volume being _attached_ and a > > partition on it being _mounted_. > > > > In your case the crypto volume contained within sd2 was attached as sd3. > > > > But quite possibly none of the partitions on sd3 was mounted on /mnt. > > > > Now you have overwritten the beginning of sd2, which is where the encryption > > keys are stored. > > > > But since it was hopefully already attached a copy of these keys will be in > > RAM, despite the fact that you have trashed the on-disk copy. > > > > So don't reset the machine now, because that copy would be lost. > > > > What happens if you do: > > > > # mount -oro /dev/sd3X /mnt > > > > Replacing X with the partition that you actually had on the external disk, > > (probably a or d). > > > > Are you able to see anything that was on the disk? > > > > If so, let us know and don't do anything else that might crash the machine. > > > > I sent a reply with some more info, do you still want me to proceed with > `mount -oro`? No, the partition is already mounted. I'm assuming that you only had this one partition on the encrypted volume sd3, and that it started at or near the beginning of the disk. In the unlikely event that you had multiple partitions on it, the second and subsequent ones might still be mountable and intact. In the more likely case that it was one large partition at the beginning, then the first ~70 Mb of sd3 have also been lost, because that data was backed by the first ~70 Mb of sd2 that you overwrote. The one glimmer of hope that you have is that you are almost certainly still reading the data on the rest of sd3, (past the first ~70 Mb), correctly decrypted, because the key is in RAM, (but overwritten on the disk). If the data was genuinely valuable as you describe, you might want to attach a new storage volume that is at least as big as sd3, and write an image of sd3 to that volume whilst you still can, (because once you reset the machine or detach the sd3 volume the key will be lost). In theory most of your data would be recoverable from that image, but it would require a lot of work and knowledge of ffs filesystem layout. If you do make an image of the disk, you could try searching it for ASCII strings and if you found any then it would confirm that the encrypted data was correctly decrypted at the time of copying. Oh, and in the future it's much easier to make backups than to go through this nightmare of data recovery.
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 22, 2024 at 11:51:53AM -0300, Crystal Kolipe wrote: > On Sat, Jun 22, 2024 at 01:02:04PM +, Anon Loli wrote: > > Hello list > > So I was trying to resolve the problem that I just submitted with the > > Installer, and I was putting a fresh install75 on my USB, the problem is > > that > > last DD/flash my USB was on sd2, and in meanwhile I attached my VERY > > IMPORTANT > > external drive to my computer which became sd2 with crypto volume attached > > as > > sd3, so it was mounted. > > There is a difference between the crypto volume being _attached_ and a > partition on it being _mounted_. > > In your case the crypto volume contained within sd2 was attached as sd3. > > But quite possibly none of the partitions on sd3 was mounted on /mnt. > > Now you have overwritten the beginning of sd2, which is where the encryption > keys are stored. > > But since it was hopefully already attached a copy of these keys will be in > RAM, despite the fact that you have trashed the on-disk copy. > > So don't reset the machine now, because that copy would be lost. > > What happens if you do: > > # mount -oro /dev/sd3X /mnt > > Replacing X with the partition that you actually had on the external disk, > (probably a or d). > > Are you able to see anything that was on the disk? > > If so, let us know and don't do anything else that might crash the machine. > I sent a reply with some more info, do you still want me to proceed with `mount -oro`?
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 22, 2024 at 11:39:12AM -0300, Crystal Kolipe wrote: > On Sat, Jun 22, 2024 at 02:33:21PM +, Anon Loli wrote: > > On Sat, Jun 22, 2024 at 11:25:32AM -0300, Crystal Kolipe wrote: > > > On Sat, Jun 22, 2024 at 01:02:04PM +, Anon Loli wrote: > > > > So, guess who did a DD with "of=/dev/rsd2c" instead of > > > > "of=/dev/rsd4c"... ME > > > > Can this volume/drive still be recovered? I think the metadata and > > > > stuff is > > > > lost > > > > "77594624 bytes transferred", so about 74M... > > > > > > First of all, STOP. Anything you do is likely to reduce the chance of > > > recovering data from it. > > > > I did, I realized my mistake the moment that I pressed enter, actually a few > > milliseconds before I pressed ENTER, but my body was too slow to react, and > > in > > my hurry to stop it, I clicked way too many buttons at once, opened a new > > terminal window, switched to a different tiling of windows and by the time I > > found the window and stopped the DD command, about 7 seconds have passed :( > > Unfortunately you've overwritten the volume which underlies the encrypted > volume. > > If you'd trashed the encrypted volume itself, (or the volume was unencrypted), > there is hope to recover some of the data, (we've actually published some info > on how to do this, which is why I said to stop immediately, because the method > relies on some metadata which happens to be in ram, and if you reset then it's > lost). > > In your case, if I understand correctly, you've overwritten the encryption key > and it's not backed up anywhere. The encrypted disk is sd2, at the time of overwritting with DD, I overwrote the RAW sd2, so rsd2, the encrypted volume (sd2) was decrypted (became sd3) and was mounted on /mnt/whatever, with this command: `mount -o rw,noatime,noexec,nodev,nosuid ...` the decrypting on the encrypted volume sd2 was decrypted with: `bioctl -v -c C -l ...` if it matters So it should still be in RAM? df -h still shows the sd3i unencrypted volume mounted on /mnt/whatever but a ls -l of that shows that it's just a file (not a directory with like +200G of data), it gives me this amongst other stuff: `c--Srwx---` and /mnt/whatever*, like it's an executable, it also says the date is 1970 of the mountpoint.. a `du -ch *` says that /mnt/whatever is "-3.9E" in size ;-; if it matters, I did a fsck exactly before mounting it which might now be my last time :(
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 22, 2024 at 01:02:04PM +, Anon Loli wrote: > Hello list > So I was trying to resolve the problem that I just submitted with the > Installer, and I was putting a fresh install75 on my USB, the problem is that > last DD/flash my USB was on sd2, and in meanwhile I attached my VERY IMPORTANT > external drive to my computer which became sd2 with crypto volume attached as > sd3, so it was mounted. There is a difference between the crypto volume being _attached_ and a partition on it being _mounted_. In your case the crypto volume contained within sd2 was attached as sd3. But quite possibly none of the partitions on sd3 was mounted on /mnt. Now you have overwritten the beginning of sd2, which is where the encryption keys are stored. But since it was hopefully already attached a copy of these keys will be in RAM, despite the fact that you have trashed the on-disk copy. So don't reset the machine now, because that copy would be lost. What happens if you do: # mount -oro /dev/sd3X /mnt Replacing X with the partition that you actually had on the external disk, (probably a or d). Are you able to see anything that was on the disk? If so, let us know and don't do anything else that might crash the machine.
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 22, 2024 at 11:25:32AM -0300, Crystal Kolipe wrote: > On Sat, Jun 22, 2024 at 01:02:04PM +, Anon Loli wrote: > > So, guess who did a DD with "of=/dev/rsd2c" instead of "of=/dev/rsd4c"... ME > > Can this volume/drive still be recovered? I think the metadata and stuff is > > lost > > "77594624 bytes transferred", so about 74M... > > First of all, STOP. Anything you do is likely to reduce the chance of > recovering data from it. I did, I realized my mistake the moment that I pressed enter, actually a few milliseconds before I pressed ENTER, but my body was too slow to react, and in my hurry to stop it, I clicked way too many buttons at once, opened a new terminal window, switched to a different tiling of windows and by the time I found the window and stopped the DD command, about 7 seconds have passed :(
Re: accidentally overwritten wrong drive with DD, please help
On Sat, Jun 22, 2024 at 01:02:04PM +, Anon Loli wrote: > So, guess who did a DD with "of=/dev/rsd2c" instead of "of=/dev/rsd4c"... ME > Can this volume/drive still be recovered? I think the metadata and stuff is > lost > "77594624 bytes transferred", so about 74M... First of all, STOP. Anything you do is likely to reduce the chance of recovering data from it.
accidentally overwritten wrong drive with DD, please help
Hello list So I was trying to resolve the problem that I just submitted with the Installer, and I was putting a fresh install75 on my USB, the problem is that last DD/flash my USB was on sd2, and in meanwhile I attached my VERY IMPORTANT external drive to my computer which became sd2 with crypto volume attached as sd3, so it was mounted. So, guess who did a DD with "of=/dev/rsd2c" instead of "of=/dev/rsd4c"... ME Can this volume/drive still be recovered? I think the metadata and stuff is lost "77594624 bytes transferred", so about 74M... FreeBSD has like a .eli metadata backup in /var/backups, does OpenBSD have anything similar? Can you please help me, this drive was my cold storage of most important data as well as childhood memories that stupidly enough are just on this drive. Is it possible to recover at least the rest of the drive if not those 74M? I'll leave everything as-is now (attached and stuff) The drive is a new SSD, and I can't see the crypto volume attached in /mnt anymore.. Please help this stupid bean :(
Re: need help to access my machine after upgrade -- system immediately logs me out
Cool. That worked. Also my system is back up and running. Turns out the i3
libraries installed had become incompatible with the rest of the system.
Simply deleted those and glib2 packages and reinstalled everything. Works
well now. Thanks for all the help :).
Cheers
Sandeep
On Wed, Apr 3, 2024 at 12:51 AM Otto Moerbeek wrote:
> On Wed, Apr 03, 2024 at 12:45:33AM +0530, Sandeep Gupta wrote:
>
> > Thank you for all the inputs. This is so useful. I am able to at least
> > access the file system and rescue the data.
> > However, I'm not able to restore the system yet. The command "pkg_add
> -u"
> > runs into "out of memory error".
> > ulimit -a shows decent memory:
> > memory(kbytes) 11872836.
>
> you want to increase the data limit, ulimit -d
>
> -Otto
>
> >
> > On Tue, Apr 2, 2024 at 5:04 PM Stuart Henderson <
> stu.li...@spacehopper.org>
> > wrote:
> >
> > > On 2024-04-01, Sandeep Gupta wrote:
> > > >
> > > > However when i tried to log from the console -- the login message
> shows
> > > but
> > > > the system logs me out immediately.
> > > > On the desktop gui too, with only root I was able to login. But
> running
> > > > xterm from the fvwm menu fails.
> > > > I am a bit clueless as to how to gain access to the system.
> > >
> > > Try this:
> > >
> > > Boot into single-user mode ("boot -s" at the boot loader prompt)
> > > fsck -p
> > > mount -a -t nonfs
> > >
> > > Hopefully that will get you access to the system. You can try looking
> at
> > > system logs to see if that gives any clues about the problem. TERM
> won't
> > > be set so you may want to use e.g. "TERM=xterm less /var/log/messages"
> > > etc. $HOME/.xsession-errors might give some clues too.
> > >
> > > If you think that updating packages might help then 'sh /etc/netstart'
> > > to get working net and proceed with pkg_add -u as usual.
> > >
> > >
> > >
>
Re: need help to access my machine after upgrade -- system immediately logs me out
On Wed, Apr 03, 2024 at 12:45:33AM +0530, Sandeep Gupta wrote:
> Thank you for all the inputs. This is so useful. I am able to at least
> access the file system and rescue the data.
> However, I'm not able to restore the system yet. The command "pkg_add -u"
> runs into "out of memory error".
> ulimit -a shows decent memory:
> memory(kbytes) 11872836.
you want to increase the data limit, ulimit -d
-Otto
>
> On Tue, Apr 2, 2024 at 5:04 PM Stuart Henderson
> wrote:
>
> > On 2024-04-01, Sandeep Gupta wrote:
> > >
> > > However when i tried to log from the console -- the login message shows
> > but
> > > the system logs me out immediately.
> > > On the desktop gui too, with only root I was able to login. But running
> > > xterm from the fvwm menu fails.
> > > I am a bit clueless as to how to gain access to the system.
> >
> > Try this:
> >
> > Boot into single-user mode ("boot -s" at the boot loader prompt)
> > fsck -p
> > mount -a -t nonfs
> >
> > Hopefully that will get you access to the system. You can try looking at
> > system logs to see if that gives any clues about the problem. TERM won't
> > be set so you may want to use e.g. "TERM=xterm less /var/log/messages"
> > etc. $HOME/.xsession-errors might give some clues too.
> >
> > If you think that updating packages might help then 'sh /etc/netstart'
> > to get working net and proceed with pkg_add -u as usual.
> >
> >
> >
Re: need help to access my machine after upgrade -- system immediately logs me out
For disclousre, I was able to access the shell/file system via Boot into
single-user mode ("boot -s" at the boot loader prompt) -- followed by
fsck -p
mount -a -t bonds as mentioned in earlier replies.
Thank you.
On Wed, Apr 3, 2024 at 12:45 AM Sandeep Gupta
wrote:
> Thank you for all the inputs. This is so useful. I am able to at least
> access the file system and rescue the data.
> However, I'm not able to restore the system yet. The command "pkg_add -u"
> runs into "out of memory error".
> ulimit -a shows decent memory:
> memory(kbytes) 11872836.
>
> On Tue, Apr 2, 2024 at 5:04 PM Stuart Henderson
> wrote:
>
>> On 2024-04-01, Sandeep Gupta wrote:
>> >
>> > However when i tried to log from the console -- the login message shows
>> but
>> > the system logs me out immediately.
>> > On the desktop gui too, with only root I was able to login. But running
>> > xterm from the fvwm menu fails.
>> > I am a bit clueless as to how to gain access to the system.
>>
>> Try this:
>>
>> Boot into single-user mode ("boot -s" at the boot loader prompt)
>> fsck -p
>> mount -a -t nonfs
>>
>> Hopefully that will get you access to the system. You can try looking at
>> system logs to see if that gives any clues about the problem. TERM won't
>> be set so you may want to use e.g. "TERM=xterm less /var/log/messages"
>> etc. $HOME/.xsession-errors might give some clues too.
>>
>> If you think that updating packages might help then 'sh /etc/netstart'
>> to get working net and proceed with pkg_add -u as usual.
>>
>>
>>
Re: need help to access my machine after upgrade -- system immediately logs me out
Thank you for all the inputs. This is so useful. I am able to at least
access the file system and rescue the data.
However, I'm not able to restore the system yet. The command "pkg_add -u"
runs into "out of memory error".
ulimit -a shows decent memory:
memory(kbytes) 11872836.
On Tue, Apr 2, 2024 at 5:04 PM Stuart Henderson
wrote:
> On 2024-04-01, Sandeep Gupta wrote:
> >
> > However when i tried to log from the console -- the login message shows
> but
> > the system logs me out immediately.
> > On the desktop gui too, with only root I was able to login. But running
> > xterm from the fvwm menu fails.
> > I am a bit clueless as to how to gain access to the system.
>
> Try this:
>
> Boot into single-user mode ("boot -s" at the boot loader prompt)
> fsck -p
> mount -a -t nonfs
>
> Hopefully that will get you access to the system. You can try looking at
> system logs to see if that gives any clues about the problem. TERM won't
> be set so you may want to use e.g. "TERM=xterm less /var/log/messages"
> etc. $HOME/.xsession-errors might give some clues too.
>
> If you think that updating packages might help then 'sh /etc/netstart'
> to get working net and proceed with pkg_add -u as usual.
>
>
>
Re: need help to access my machine after upgrade -- system immediately logs me out
Stuart Henderson : > > Running out of space (especially in /usr) during sysupgrade might > do it too. When in single mode I reccomend to check also the root for /dev content, 90% of times I run out of space happens there to me, anyway I'm not sure about the connection with xterm and sysupgrade. -Dan
Re: need help to access my machine after upgrade -- system immediately logs me out
On 2024-04-01, Peter N. M. Hansteen wrote: > > This sounds very much like a situation where the base system and packages > are out seriously of sync AND your user is et up with a default shell from > packages (I am guessing bash). Running out of space (especially in /usr) during sysupgrade might do it too. Or a bad sysmerge run for something like /etc/login.conf. Plenty of possibilities :-)
Re: need help to access my machine after upgrade -- system immediately logs me out
On 2024-04-01, Sandeep Gupta wrote:
>
> However when i tried to log from the console -- the login message shows but
> the system logs me out immediately.
> On the desktop gui too, with only root I was able to login. But running
> xterm from the fvwm menu fails.
> I am a bit clueless as to how to gain access to the system.
Try this:
Boot into single-user mode ("boot -s" at the boot loader prompt)
fsck -p
mount -a -t nonfs
Hopefully that will get you access to the system. You can try looking at
system logs to see if that gives any clues about the problem. TERM won't
be set so you may want to use e.g. "TERM=xterm less /var/log/messages"
etc. $HOME/.xsession-errors might give some clues too.
If you think that updating packages might help then 'sh /etc/netstart'
to get working net and proceed with pkg_add -u as usual.
Re: need help to access my machine after upgrade -- system immediately logs me out
If you have Xenocara installed, then I assume you can use xedit to modify files on the system. I don't know twm, but it is probably possible to create a new entry in its menu, through which you could run "xterm -e /bin/sh" to override the default shell. If this is not possible using twm, then switch to cwm, which definetely lets do this. Regards, --ext Sandeep Gupta írta 2024. ápr.. 2, K-n 11:29 órakor: > Very likely that would be issue. The problem is that I am not able to > access a shell for root or the regular user. > On the console, I get logged out immediately. On GUI, fvwm, the root is > able to login. I can launch top and other utilities. > But I am not able to launch xterm. I guess I would have to boot using > external usb, mount the disk and repair it. > > On Tue, Apr 2, 2024 at 1:57 AM Peter N. M. Hansteen wrote: >> On Tue, Apr 02, 2024 at 12:44:01AM +0530, Sandeep Gupta wrote: >> > Hello, >> > >> > I need to access my desktop local machine after I did a sysupgrade -s (I >> > had reasons to do so because some rust libraries were too old for some >> > applications). >> > Sysupgrade seems to have gone fine. Disk is healthy no issues reported. >> > >> > However when i tried to log from the console -- the login message shows but >> > the system logs me out immediately. >> > On the desktop gui too, with only root I was able to login. But running >> > xterm from the fvwm menu fails. >> >> This sounds very much like a situation where the base system and packages >> are out seriously of sync AND your user is et up with a default shell from >> packages (I am guessing bash). >> >> The solution would likely be to log in as root, run pkg_add -D snap -u >> to get the latest snapshot packages, then try to log in as your regular user. >> >> >> -- >> Peter N. M. Hansteen, member of the first RFC 1149 implementation team >> https://bsdly.blogspot.com/ https://www.bsdly.net/ https://www.nuug.no/ >> "Remember to set the evil bit on all malicious network traffic" >> delilah spamd[29949]: 85.152.224.147: disconnected after 42673 seconds. >> -- --Z--
Re: need help to access my machine after upgrade -- system immediately logs me out
Very likely that would be issue. The problem is that I am not able to access a shell for root or the regular user. On the console, I get logged out immediately. On GUI, fvwm, the root is able to login. I can launch top and other utilities. But I am not able to launch xterm. I guess I would have to boot using external usb, mount the disk and repair it. On Tue, Apr 2, 2024 at 1:57 AM Peter N. M. Hansteen wrote: > On Tue, Apr 02, 2024 at 12:44:01AM +0530, Sandeep Gupta wrote: > > Hello, > > > > I need to access my desktop local machine after I did a sysupgrade -s (I > > had reasons to do so because some rust libraries were too old for some > > applications). > > Sysupgrade seems to have gone fine. Disk is healthy no issues reported. > > > > However when i tried to log from the console -- the login message shows > but > > the system logs me out immediately. > > On the desktop gui too, with only root I was able to login. But running > > xterm from the fvwm menu fails. > > This sounds very much like a situation where the base system and packages > are out seriously of sync AND your user is et up with a default shell from > packages (I am guessing bash). > > The solution would likely be to log in as root, run pkg_add -D snap -u > to get the latest snapshot packages, then try to log in as your regular > user. > > > -- > Peter N. M. Hansteen, member of the first RFC 1149 implementation team > https://bsdly.blogspot.com/ https://www.bsdly.net/ https://www.nuug.no/ > "Remember to set the evil bit on all malicious network traffic" > delilah spamd[29949]: 85.152.224.147: disconnected after 42673 seconds. > >
Re: need help to access my machine after upgrade -- system immediately logs me out
2024-04-01T19:17:31Z Sandeep Gupta : > Hello, > > I need to access my desktop local machine after I did a sysupgrade -s (I had > reasons to do so because some rust libraries were too old for some > applications). > Sysupgrade seems to have gone fine. Disk is healthy no issues reported. > > However when i tried to log from the console -- the login message shows but > the system logs me out immediately. > On the desktop gui too, with only root I was able to login. But running xterm > from the fvwm menu fails. > I am a bit clueless as to how to gain access to the system. > Some help would be great. > -S (didn't reply to list so here it goes again) Could it be that something on your .xsession is failing and thereby terminating the X session early (before being able to start fvwm)?
Re: need help to access my machine after upgrade -- system immediately logs me out
On Tue, Apr 02, 2024 at 12:44:01AM +0530, Sandeep Gupta wrote: > Hello, > > I need to access my desktop local machine after I did a sysupgrade -s (I > had reasons to do so because some rust libraries were too old for some > applications). > Sysupgrade seems to have gone fine. Disk is healthy no issues reported. > > However when i tried to log from the console -- the login message shows but > the system logs me out immediately. > On the desktop gui too, with only root I was able to login. But running > xterm from the fvwm menu fails. This sounds very much like a situation where the base system and packages are out seriously of sync AND your user is et up with a default shell from packages (I am guessing bash). The solution would likely be to log in as root, run pkg_add -D snap -u to get the latest snapshot packages, then try to log in as your regular user. -- Peter N. M. Hansteen, member of the first RFC 1149 implementation team https://bsdly.blogspot.com/ https://www.bsdly.net/ https://www.nuug.no/ "Remember to set the evil bit on all malicious network traffic" delilah spamd[29949]: 85.152.224.147: disconnected after 42673 seconds.
need help to access my machine after upgrade -- system immediately logs me out
Hello, I need to access my desktop local machine after I did a sysupgrade -s (I had reasons to do so because some rust libraries were too old for some applications). Sysupgrade seems to have gone fine. Disk is healthy no issues reported. However when i tried to log from the console -- the login message shows but the system logs me out immediately. On the desktop gui too, with only root I was able to login. But running xterm from the fvwm menu fails. I am a bit clueless as to how to gain access to the system. Some help would be great. -S
Re: I can't get contributors for my C project. Can you help?
Dear Jan: I'll do as I wish; and if you want to stop me you'll have to
physically kill me.
Do you understand, woman?
And if you want to be in a fight or contest with me, of some kind; either legal
or otherwise.:
that can be arranged I suppose.
Do you understand, woman?
I'll make sure I post this to misc@openbsd.org
And I will remember that you did not assist my opensource project in realizing
Unreal map format loading;
and that you wish for my project to not even be-able to ask for fellow C
programmers help.
Do you understand, woman.
This is a direct warning aimed at your person.
Woman.
I will be glad when your civilization is erased.
Along with it's millions of police and white men that enforce your rights
(derived from the New Testament, and
the newer parts of the old testament; in contrivance to the original parts of
the law of the God: which you,
a woman, the first mentioned parts support, and the latter mentioned law;
revile)
---
If there is anyone that wishes to reject the New Testament pro-women's rights
belief system that Jan epitomizes,
("castrate yourself for heaven" --matthew 19 greek, "no male nor female",
"don't stone women", "better a millstone" (drown anyone that likes young
girls), "turn the other cheek", "obey all earthly rulers")
and further reject the newer-parts-of-the-old-testament writings (some of which
were "discovered" in the 1500s; including
one where a woman "saves" various people from Iran, for some reason)
And instead do the much disliked work of C programming, while, perhaps, being
infavor of the original laws of the Old Testament
(marrying little girls is fine (padia, na'ar*, puella) (including in cases of
rape (tahphas**)) Devarim 22, verse 28, (hebrew, greek, latin).
(*"moses was a crying na'ar" (exodus) when pharo's darughter pulled him from
the river: yes white people: na'ar means child)
(**to take: as to take a city)
(kill adulterous women) (Devarim)
(man is the ba'al (master, ruler) of the woman) (Devarim)
(if anyone entices you to follow another Power: kill them) (Devarim)
(no euniches in the assembly of the ruler) (Devarim)
[Above are the laws and beliefs that white people, chirstians, and good people
reject.]
[Just as they have come to reject programming in C.]
[Beliefs that Jan, as a woman, opposes aswell]
[Just as the pre-hellenistic world in greece held men in slavery; ruled over by
women;]
[Today men are held in bondage; mental and otherwise; by the 2 million police
women can call at a moments notice.]
[Men have lost all the rights they gained in the past; they have subsumed
themselves to a trans-demi-god (New Testament)]
[And have reread all earlier works in light of that.]
Then please explore this link which has the source code and all supporting
source code that has been discovered, regarding Unreal map loading:
sf.net/p/chaosesqueanthology/tickets/2/
TLDR: I'm glad the taliban won; because they marry little girls; just as YHWH's
law allows.
Please help opensource game with UNREAL map loading.
And if you don't because you oppose child brides: then I will remember you as
an enemy.
I hope western civilization falls and all your daughers are married before
menarche (first blood) as true virgins (rabbinical)
On Saturday, December 16, 2023 at 02:20:48 PM EST, Jan Stary
wrote:
Don't post this crap to misc@openbsd.org
On Dec 16 18:00:35, chaosesquet...@yahoo.com wrote:
> I wish I could accept your offer.
> I don't have any money though, at all.
> If I had any I would be glad for your offer and accept.
> But I never got into the bitcoin stuff, even when it just started and was
> being advertised on slashdot.
>
> If I had money I would definitely accept however.
> I just don't.
>
> I dream to get this opensource engine working with the unreal map format.
>
>
>
> On Saturday, December 16, 2023 at 10:40:30 AM EST,
> wrote:
>
>
>
>
>
> Hello. I'm intersted in your task. I'm quite comfortable with C in
> general and currently working on graphics related things. I could
> give you a hand for a fair fee. Would you be interested in that?
>
>
Re: I can't get contributors for my C project. Can you help?
I wish I could accept your offer. I don't have any money though, at all. If I had any I would be glad for your offer and accept. But I never got into the bitcoin stuff, even when it just started and was being advertised on slashdot. If I had money I would definitely accept however. I just don't. I dream to get this opensource engine working with the unreal map format. On Saturday, December 16, 2023 at 10:40:30 AM EST, wrote: Hello. I'm intersted in your task. I'm quite comfortable with C in general and currently working on graphics related things. I could give you a hand for a fair fee. Would you be interested in that?
Re: I can't get contributors for my C project. Can you help?
Thanks. I don't know either. The engine is a pure C project (nothing else, engine wise). So I need to talk to (fellow) C programmers. Its main area of interest is old 3d file formats from the golden age of 3d shooters. That limits where one can discuss since no one seems to like C anymore. On Saturday, December 16, 2023 at 11:40:52 AM EST, Peter N. M. Hansteen wrote: On Sat, Dec 16, 2023 at 02:18:48PM +, chaosesquet...@yahoo.com wrote: > Why won't anyone help my free software project? > I simply want help with the unreal map format. > https://sourceforge.net/p/chaosesqueanthology/tickets/2/ If you are not getting any response, you are most likely not addressing the right forums or individuals. Then again, I have no idea what would be the proper forum(s) for this. All the best, Peter (who you reached via openbsd-misc) -- Peter N. M. Hansteen, member of the first RFC 1149 implementation team https://bsdly.blogspot.com/ https://www.bsdly.net/ https://www.nuug.no/ "Remember to set the evil bit on all malicious network traffic" delilah spamd[29949]: 85.152.224.147: disconnected after 42673 seconds.
Re: I can't get contributors for my C project. Can you help?
Why won't anyone help my free software project? I simply want help with the unreal map format. https://sourceforge.net/p/chaosesqueanthology/tickets/2/
Re: I can't get contributors for my C project. Can you help?
Bruce Perens; Thank's for responding. I mean that. No one else ever does :( *Message Main Body: Where am I supposed to send it? Every opensource forum I go to is basically shut down now: even slashdot (they don't even allow new registrations). No one seems to use C anymore: even though it's not /that/ much harder than any of the new programming languages: you just got to say where you want to store your data. Everyone is afraid of that now for some reason. I've found C to be very similar to PERL, and QuakeC, it's just easy to use as one or the other. And C is alot faster. I don't know why people trash it. So I send it to the few C programs I know still are kicking. I really don't have any other solution for communication: everywhere else is a complete ghost town. Things changed alot in these last 10 years. I remeber when all one had to do was post in any random article on slashdot, in the comments section, and one would have like 12 people the next day interested in the opensource project. Now everything's shuttered, silo'd, and dead :( And I don't want to attempt to communicate on ... X? a walled garden and a firehose put together. *Message Addendum: --- *Long story short; *We want the unreal map file types. *sf.net/p/chaosesqueanthology /tickets/2/ *.t3d and .unr file formats t3d format is nice; but requires more math grinding. .unr format is ... less nice... but requires less math (ie format more complex; but less processing is required) On Sunday, October 8, 2023 at 08:25:38 PM EDT, Bruce Perens wrote: Mikey, This is why nobody wants to help you. On Sat, Oct 7, 2023 at 7:29 AM chaosesquet...@yahoo.com wrote: > Bagas; > There is no other place that C projects are talked about. In the past I could > get help and contributors just asking; now you are all silo'd in your own > little worlds and seethe with extreme anger or some castrated-drug-stupor in > "irony" and smugness against anyone that asks for some contributors. Every > single place bans anyone that asks for contributors to free-software projects. > > You feel you are superior because you "did code" 10 years ago and "support > trans rights". > When asked to even allow a message to be seen that asks for contributors, in > this case a file format, to a fellow C project: you seethe or pretend you are > superior. > As if I didn't know where I was sending the message? > I sent it to: RMS, ESR, Bruce Perens, redhat, OpenBSD, NetBSD, and Line-Unix. > All C projects. Just like this engine. > I'm just asking for contributors. Not promoting "outrecehery" (some feminist > BS), Not "master vs main", not "noo can't call things whitelist/blacklist", > and not Codes Of Conducts for free contributors. I'm just asking for C > programming help for 3d file formats I'd like to add to this free-software > project. > > sourceforge.net/p/chaosesqueanthology/tickets/2/ > > > > > > > > On Saturday, October 7, 2023 at 04:56:51 AM EDT, Bagas Sanjaya > wrote: > > > > > > On Fri, Oct 06, 2023 at 07:18:20PM +, chaosesquet...@yahoo.com wrote: >> Dear RMS; >> >> I've read that you are both a lisp and C developer. I cannot get any >> contributors for the longstanding C 3d engine I work on as part of my >> fully-free-software (including media) 3d game/architecture project. I've >> been working on it alone for 10 years but now have branched into supporting >> more 3d file types and can't do that alone. >> >> I've gone to "opensource" forums and gotten banned every single time for >> asking for help. Every single time. The message gets deleted. This is >> extremely difficult: it's not like 20 years ago when communication was free. >> Obvs the "opensource" community is no longer interested in any collaboration >> or development. >> >> The reason I wanted to find more contributors, is that I recently (last 2 >> years) programmed more file format support myself >> (wolfenstine:enemyterritory bsp support) and extended and fixed support for >> existing formats (obj file support for use as maps, and support for minetest >> and minecraft object exports as maps directly into the game, and BZFlag >> exported obj as maps (these didn't work at all before: now they do (bzflag >> and the engine previously had different opinions on what an obj file was >> mathmatically))). That opened up 600 3d maps with the bsp work, and then >> 1000s of obj files with the obj_to_mc work. So I felt I was on a roll. >> Sketchfab was "opened up" and lots of free-software-lice
Can you help our opensource project (file formats)?
We want the unreal map file types. http://sf.net/p/chaosesqueanthology /tickets/2/ .t3d and .unr file formats
I can't get contributors for my C project. Can you help?
Dear RMS; I've read that you are both a lisp and C developer. I cannot get any contributors for the longstanding C 3d engine I work on as part of my fully-free-software (including media) 3d game/architecture project. I've been working on it alone for 10 years but now have branched into supporting more 3d file types and can't do that alone. I've gone to "opensource" forums and gotten banned every single time for asking for help. Every single time. The message gets deleted. This is extremely difficult: it's not like 20 years ago when communication was free. Obvs the "opensource" community is no longer interested in any collaboration or development. The reason I wanted to find more contributors, is that I recently (last 2 years) programmed more file format support myself (wolfenstine:enemyterritory bsp support) and extended and fixed support for existing formats (obj file support for use as maps, and support for minetest and minecraft object exports as maps directly into the game, and BZFlag exported obj as maps (these didn't work at all before: now they do (bzflag and the engine previously had different opinions on what an obj file was mathmatically))). That opened up 600 3d maps with the bsp work, and then 1000s of obj files with the obj_to_mc work. So I felt I was on a roll. Sketchfab was "opened up" and lots of free-software-licensed terrain and such were easily used from there. It was nice. I wanted to keep going. I thought it might be possible to get unreal 97 and unreal tournament 99 3d map formats working: as there are tons of maps there and I used to make little 3d worlds using that format. The two main formats here are .t3d ; an ascii format (like obj) but which requires CSG math, and .unr : a binary format which pre-compiles the csg math down to vertex and face info; but is more complex a format. I found free software projects in C++ that tackle each (my project is in C): that could be used to learn the math. The t3d one even does the csg work. I just need to plead to you: please: I need contributors now. I did everything I could in these last 10 years under free-software licenses: made lots of maps, made tons of 3d models, made textures, game code (QuakeC), engine code (C). I extended the engine to beable to address up to 4 million entities, I programmed procedural map generation routines that allow creating cities out of nothing. I modeled tons of buildings, with both interiors, and level-of-detail models; so you can explore cities and not just go on the ourside of buildings. I modeled vehicles, added vehicles, programmed vehicles. I added 200 wps, and building code so players can do whatever they want in this 3d platform: from architecture, city building, town building, to fighting eachother, or racing cars, helicopters, to putting out fires. I've made music for it. All free software licensed. I just cannot get contributors. Every single place I post a plea for help the thing is banned and deleted.The only thing I've gotten is people trying to take down the project because they're mad I dared asked for file format help or for another programmer to join.Can you and the free software people help? I've asked "opensource" they sad "banned" and "scram"So I turn to you. It's in C. Your language.Please.I beg of you. I can't do these file formats alone. --Here's a ticket of the issue: sourceforge.net/p/chaosesqueanthology/tickets/2/ ( #2 Please help with .t3d and .unr loading (3d world file types) )Here's a git of the source code: sourceforge.net/p/chaosesqueanthology/code-t3d_attempt_engine/ci/master/tree/And here is a tarball of the source code: sourceforge.net/p/chaosesqueanthology/discussion/general/thread/72c4ff80c1/f23d/attachment/darkplaces_workingon_sep_06_2023_aug19cde_SOURCEONLY.tar.gz I started in model_brush.c , added in a new file handler: voidT3d_Attempt_Which_will_Mod_OBJ_Load(dp_model_t mod, void buffer,void *bufferend)and got it printing the vertex info of the t3d stuff. I found 2 free software projects that handle (in C++) the two file formats, and I asked them for help but no response: (.t3d) T3d2Map(C++): github.com/mildred/t3d2map (.unr) UShock(C++): sourceforge.net/projects/ushock/ So I just need help here.I cannot do this part of the engine coding alone.I know I did other formats: but it was alot of hacking and they weren't too different.But here: it would take me years since I'm a hacker (at best) and not a professional file programmer. Please help. Is there anywhere I can ask? Everywhere seems shutdown, filterd, and blocked, and very very unfriendly to any C dev requests.Hope you get well soon.
I can't get contributors for my C project. Can you help?
Dear RMS; I've read that you are both a lisp and C developer. I cannot get any contributors for the longstanding C 3d engine I work on as part of my fully-free-software (including media) 3d game/architecture project. I've been working on it alone for 10 years but now have branched into supporting more 3d file types and can't do that alone. I've gone to "opensource" forums and gotten banned every single time for asking for help. Every single time. The message gets deleted. This is extremely difficult: it's not like 20 years ago when communication was free. Obvs the "opensource" community is no longer interested in any collaboration or development. The reason I wanted to find more contributors, is that I recently (last 2 years) programmed more file format support myself (wolfenstine:enemyterritory bsp support) and extended and fixed support for existing formats (obj file support for use as maps, and support for minetest and minecraft object exports as maps directly into the game, and BZFlag exported obj as maps (these didn't work at all before: now they do (bzflag and the engine previously had different opinions on what an obj file was mathmatically))). That opened up 600 3d maps with the bsp work, and then 1000s of obj files with the obj_to_mc work. So I felt I was on a roll. Sketchfab was "opened up" and lots of free-software-licensed terrain and such were easily used from there. It was nice. I wanted to keep going. I thought it might be possible to get unreal 97 and unreal tournament 99 3d map formats working: as there are tons of maps there and I used to make little 3d worlds using that format. The two main formats here are .t3d ; an ascii format (like obj) but which requires CSG math, and .unr : a binary format which pre-compiles the csg math down to vertex and face info; but is more complex a format. I found free software projects in C++ that tackle each (my project is in C): that could be used to learn the math. The t3d one even does the csg work. I just need to plead to you: please: I need contributors now. I did everything I could in these last 10 years under free-software licenses: made lots of maps, made tons of 3d models, made textures, game code (QuakeC), engine code (C). I extended the engine to beable to address up to 4 million entities, I programmed procedural map generation routines that allow creating cities out of nothing. I modeled tons of buildings, with both interiors, and level-of-detail models; so you can explore cities and not just go on the ourside of buildings. I modeled vehicles, added vehicles, programmed vehicles. I added 200 wps, and building code so players can do whatever they want in this 3d platform: from architecture, city building, town building, to fighting eachother, or racing cars, helicopters, to putting out fires. I've made music for it. All free software licensed. I just cannot get contributors. Every single place I post a plea for help the thing is banned and deleted. The only thing I've gotten is people trying to take down the project because they're mad I dared asked for file format help or for another programmer to join. Can you and the free software people help? I've asked "opensource" they sad "banned" and "scram" So I turn to you. It's in C. Your language. Please. I beg of you. I can't do these file formats alone. -- Here's a ticket of the issue: sourceforge.net/p/chaosesqueanthology/tickets/2/ ( #2 Please help with .t3d and .unr loading (3d world file types) ) Here's a git of the source code: sourceforge.net/p/chaosesqueanthology/code-t3d_attempt_engine/ci/master/tree/ And here is a tarball of the source code: sourceforge.net/p/chaosesqueanthology/discussion/general/thread/72c4ff80c1/f23d/attachment/darkplaces_workingon_sep_06_2023_aug19cde_SOURCEONLY.tar.gz I started in model_brush.c , added in a new file handler: void T3d_Attempt_Which_will_Mod_OBJ_Load(dp_model_t mod, void buffer, void *bufferend) and got it printing the vertex info of the t3d stuff. I found 2 free software projects that handle (in C++) the two file formats, and I asked them for help but no response: (.t3d) T3d2Map(C++): github.com/mildred/t3d2map (.unr) UShock(C++): sourceforge.net/projects/ushock/ So I just need help here. I cannot do this part of the engine coding alone. I know I did other formats: but it was alot of hacking and they weren't too different. But here: it would take me years since I'm a hacker (at best) and not a professional file programmer. Please help. Is there anywhere I can ask? Everywhere seems shutdown, filterd, and blocked, and very very unfriendly to any C dev requests. Hope you get well soon.
the figure -- Re: Please help: ssh_exchange_identification: read: Connection reset by peer
I am sorry.
A somewhat different but at least visible version of the Test setup is
available here:
https://datatracker.ietf.org/doc/html/draft-ietf-bmwg-benchmarking-stateful#test_setup_sfnat64_multi
Gábor
9/3/2023 8:45 PM keltezéssel, Gabor LENCSE írta:
Dear List Members,
I have a weird problem, when I try to ssh to an OpenBSD server. (I use
OpenBSD 7.3 with GENERIC.MP #1125 kernel.)
I perform benchmarking tests to measure the performance of OpenBSD
PF. I use the below test setup:
2001:2::[-]:2/64 198.19.0.0/15 - 198.19.255.254/15
\ +--+ /
IPv6 \ |Initiator Responder| /
+-| Tester |<+
| addresses | [state table]| public IPv4 |
| +--+ |
| |
| +--+ |
| 2001:2::1/64| DUT: | public IPv4 |
+>| Stateful NAT64 gateway |-+
IPv6 address | [connection tracking table] | \
+--+ \
198.18.0.1/15
(As for the actual tests, I use only sub-ranges from the potential IP
address ranges shown above.)
The Tester is executed on a Linux server. During my tests, a bash
shell script (running on the Linux server) executes various commands
on the DUT (Device Under Test), which is the OpenBSD server. To that
end, I use ssh with key based authentication. Usually everything goes
well, but after a while, things "go wrong", and I cannot ssh from the
Linux server to the OpenBSD server any more. I get the following error
message:
root@tester:~/siitperf# ssh 172.16.17.102
ssh_exchange_identification: read: Connection reset by peer
root@tester:~/siitperf#
Then I even cannot ssh from the OpenBSD server to itself:
dut# ssh localhost
getsockname failed: Connection reset by peer
banner exchange: Connection to 127.0.0.1 port -1: Broken pipe
dut# ssh 172.16.17.102
getsockname failed: Connection reset by peer
banner exchange: Connection to UNKNOWN port -1: Broken pipe
dut#
To be able to perform the tests, I set various things by my scripts,
and perhaps one of them could be the culprit, but I cannot find it. I
execute the scripts in the /root/DUT-settings directory of the OpenBSD
server from the bash shell script running on the tester using ssh. The
relevant scripts are:
dut# pwd
/root/DUT-settings
dut# cat set-nat64-varip # this one sets static NDP and ARP entries
/root/DUT-settings/set-ndm-left 0 3999
/root/DUT-settings/set-arpm-right 2 1001
dut# cat set-ndm-left
for i in $(seq $1 $2)
do
h=$(printf "%x" $i)
ndp -s 2001:2::$h:2 24:6e:96:3c:3f:40 permanent
done
dut# cat set-ndm-right
for i in $(seq $1 $2)
do
h=$(printf "%x" $i)
ndp -s 2001:2:0:8000::$h:2 24:6e:96:3c:3f:42 permanent
done
dut# cat set-pf
pfctl -f /etc/pf-set-nat64
dut# cat /etc/pf-set-nat64
# $OpenBSD: pf.conf,v 1.55 2017/12/03 20:40:04 sthen Exp $
#
# See pf.conf(5) and /etc/examples/pf.conf
set skip on lo
block return # block stateless traffic
pass # establish keep-state
# By default, do not permit remote connections to X11
block return in on ! lo0 proto tcp to port 6000:6010
# Port build user does not need network
block return out log proto {tcp udp} user _pbuild
set skip on em1 # to protect ssh
set limit states 10 # 1000M
set timeout interval 3600 # 1 hour
pass in on ix0 inet6 from any to 64:ff9b::/96 af-to inet from 198.19.0.1
dut#
When everything is set, then the test follows. I have two kinds of tests.
1) Maximum connection establishment rate test. It sends 4M test frames
with all different source IP address and destination IP address
combinations to establish 4M connections. The test uses a binary
search to find the highest rate at which all connections are
established. (In fact it is not checked. What is checked, is that all
test frames arrive back the the Tester.)
2) Throughput test. First, the 4M connections are loaded into the
connection tracking table of PF. Then comes the throughput test with
bidirectional traffic. One elementary test last for 60s. A binary
search is used to find the highest rate at which all frames are
forwarded.
In the case of both tests, I reboot the DUT after each elementary step
of the binary search. Its aim is to completely clear the connection
tracking table of PF. And, IMHO, it should put the OpenBSD server into
a well defined, clear state. After which, it should behave the in the
same way, every time.
And now come the weird things. The maximum connection establishment
rate test was successful. The binary search was executed 10 times
without any problem. As for the throughput test, the binary search was
done ones fully. (It means 9 steps.)
Here is the first result:
No, Size, Dir, n, m, Duration, Initial Rate, N, M, R, T, D, Error,
Date, Iterations needed, rate
1, 84, b, 2, 2,
Re: Please help: ssh_exchange_identification: read: Connection reset by peer
I send the figure again. Now I surely used only spaces and not tabs:
*2001:2::[-]:2/64198.19.0.0/15 - 198.19.255.254/15*
*\+--+/*
*IPv6\ |InitiatorResponder| /*
*+-|Tester|<+*
*| addresses|[state table]| public IPv4 |*
*|+--+|*
*||*
*|+--+|*
*| 2001:2::1/64|DUT:| public IPv4 |*
*+>|Stateful NAT64 gateway|-+*
*IPv6 address |[connection tracking table]| \*
*+--+\*
*198.18.0.1/15*
Gábor
9/3/2023 8:45 PM keltezéssel, Gabor LENCSE írta:
Dear List Members,
I have a weird problem, when I try to ssh to an OpenBSD server. (I use
OpenBSD 7.3 with GENERIC.MP #1125 kernel.)
I perform benchmarking tests to measure the performance of OpenBSD
PF. I use the below test setup:
2001:2::[-]:2/64 198.19.0.0/15 - 198.19.255.254/15
\ +--+ /
IPv6 \ |Initiator Responder| /
+-| Tester |<+
| addresses | [state table]| public IPv4 |
| +--+ |
| |
| +--+ |
| 2001:2::1/64| DUT: | public IPv4 |
+>| Stateful NAT64 gateway |-+
IPv6 address | [connection tracking table] | \
+--+ \
198.18.0.1/15
(As for the actual tests, I use only sub-ranges from the potential IP
address ranges shown above.)
The Tester is executed on a Linux server. During my tests, a bash
shell script (running on the Linux server) executes various commands
on the DUT (Device Under Test), which is the OpenBSD server. To that
end, I use ssh with key based authentication. Usually everything goes
well, but after a while, things "go wrong", and I cannot ssh from the
Linux server to the OpenBSD server any more. I get the following error
message:
root@tester:~/siitperf# ssh 172.16.17.102
ssh_exchange_identification: read: Connection reset by peer
root@tester:~/siitperf#
Then I even cannot ssh from the OpenBSD server to itself:
dut# ssh localhost
getsockname failed: Connection reset by peer
banner exchange: Connection to 127.0.0.1 port -1: Broken pipe
dut# ssh 172.16.17.102
getsockname failed: Connection reset by peer
banner exchange: Connection to UNKNOWN port -1: Broken pipe
dut#
To be able to perform the tests, I set various things by my scripts,
and perhaps one of them could be the culprit, but I cannot find it. I
execute the scripts in the /root/DUT-settings directory of the OpenBSD
server from the bash shell script running on the tester using ssh. The
relevant scripts are:
dut# pwd
/root/DUT-settings
dut# cat set-nat64-varip # this one sets static NDP and ARP entries
/root/DUT-settings/set-ndm-left 0 3999
/root/DUT-settings/set-arpm-right 2 1001
dut# cat set-ndm-left
for i in $(seq $1 $2)
do
h=$(printf "%x" $i)
ndp -s 2001:2::$h:2 24:6e:96:3c:3f:40 permanent
done
dut# cat set-ndm-right
for i in $(seq $1 $2)
do
h=$(printf "%x" $i)
ndp -s 2001:2:0:8000::$h:2 24:6e:96:3c:3f:42 permanent
done
dut# cat set-pf
pfctl -f /etc/pf-set-nat64
dut# cat /etc/pf-set-nat64
# $OpenBSD: pf.conf,v 1.55 2017/12/03 20:40:04 sthen Exp $
#
# See pf.conf(5) and /etc/examples/pf.conf
set skip on lo
block return # block stateless traffic
pass # establish keep-state
# By default, do not permit remote connections to X11
block return in on ! lo0 proto tcp to port 6000:6010
# Port build user does not need network
block return out log proto {tcp udp} user _pbuild
set skip on em1 # to protect ssh
set limit states 10 # 1000M
set timeout interval 3600 # 1 hour
pass in on ix0 inet6 from any to 64:ff9b::/96 af-to inet from 198.19.0.1
dut#
When everything is set, then the test follows. I have two kinds of tests.
1) Maximum connection establishment rate test. It sends 4M test frames
with all different source IP address and destination IP address
combinations to establish 4M connections. The test uses a binary
search to find the highest rate at which all connections are
established. (In fact it is not checked. What is checked, is that all
test frames arrive back the the Tester.)
2) Throughput test. First, the 4M connections are loaded into the
connection tracking table of PF. Then comes the throughput test with
bidirectional traffic. One elementary test last for 60s. A binary
search is used to find the highest rate at which all frames are
forwarded.
In the case of both tests, I reboot the DUT after each elementary step
of the binary search. Its aim is to completely clear the connection
tracking table of PF. And, IMHO, it should put the OpenBSD server into
a well defined, clear state. After which, it should behave the in the
same way, every time.
Please help: ssh_exchange_identification: read: Connection reset by peer
Dear List Members,
I have a weird problem, when I try to ssh to an OpenBSD server. (I use
OpenBSD 7.3 with GENERIC.MP #1125 kernel.)
I perform benchmarking tests to measure the performance of OpenBSD PF.
I use the below test setup:
2001:2::[-]:2/64 198.19.0.0/15 - 198.19.255.254/15
\ +--+ /
IPv6 \ |Initiator Responder| /
+-| Tester |<+
| addresses | [state table]| public IPv4 |
| +--+ |
| |
| +--+ |
| 2001:2::1/64| DUT: | public IPv4 |
+>| Stateful NAT64 gateway |-+
IPv6 address | [connection tracking table] | \
+--+ \
198.18.0.1/15
(As for the actual tests, I use only sub-ranges from the potential IP
address ranges shown above.)
The Tester is executed on a Linux server. During my tests, a bash shell
script (running on the Linux server) executes various commands on the
DUT (Device Under Test), which is the OpenBSD server. To that end, I use
ssh with key based authentication. Usually everything goes well, but
after a while, things "go wrong", and I cannot ssh from the Linux server
to the OpenBSD server any more. I get the following error message:
root@tester:~/siitperf# ssh 172.16.17.102
ssh_exchange_identification: read: Connection reset by peer
root@tester:~/siitperf#
Then I even cannot ssh from the OpenBSD server to itself:
dut# ssh localhost
getsockname failed: Connection reset by peer
banner exchange: Connection to 127.0.0.1 port -1: Broken pipe
dut# ssh 172.16.17.102
getsockname failed: Connection reset by peer
banner exchange: Connection to UNKNOWN port -1: Broken pipe
dut#
To be able to perform the tests, I set various things by my scripts, and
perhaps one of them could be the culprit, but I cannot find it. I
execute the scripts in the /root/DUT-settings directory of the OpenBSD
server from the bash shell script running on the tester using ssh. The
relevant scripts are:
dut# pwd
/root/DUT-settings
dut# cat set-nat64-varip # this one sets static NDP and ARP entries
/root/DUT-settings/set-ndm-left 0 3999
/root/DUT-settings/set-arpm-right 2 1001
dut# cat set-ndm-left
for i in $(seq $1 $2)
do
h=$(printf "%x" $i)
ndp -s 2001:2::$h:2 24:6e:96:3c:3f:40 permanent
done
dut# cat set-ndm-right
for i in $(seq $1 $2)
do
h=$(printf "%x" $i)
ndp -s 2001:2:0:8000::$h:2 24:6e:96:3c:3f:42 permanent
done
dut# cat set-pf
pfctl -f /etc/pf-set-nat64
dut# cat /etc/pf-set-nat64
# $OpenBSD: pf.conf,v 1.55 2017/12/03 20:40:04 sthen Exp $
#
# See pf.conf(5) and /etc/examples/pf.conf
set skip on lo
block return # block stateless traffic
pass # establish keep-state
# By default, do not permit remote connections to X11
block return in on ! lo0 proto tcp to port 6000:6010
# Port build user does not need network
block return out log proto {tcp udp} user _pbuild
set skip on em1 # to protect ssh
set limit states 10 # 1000M
set timeout interval 3600 # 1 hour
pass in on ix0 inet6 from any to 64:ff9b::/96 af-to inet from 198.19.0.1
dut#
When everything is set, then the test follows. I have two kinds of tests.
1) Maximum connection establishment rate test. It sends 4M test frames
with all different source IP address and destination IP address
combinations to establish 4M connections. The test uses a binary search
to find the highest rate at which all connections are established. (In
fact it is not checked. What is checked, is that all test frames arrive
back the the Tester.)
2) Throughput test. First, the 4M connections are loaded into the
connection tracking table of PF. Then comes the throughput test with
bidirectional traffic. One elementary test last for 60s. A binary search
is used to find the highest rate at which all frames are forwarded.
In the case of both tests, I reboot the DUT after each elementary step
of the binary search. Its aim is to completely clear the connection
tracking table of PF. And, IMHO, it should put the OpenBSD server into a
well defined, clear state. After which, it should behave the in the same
way, every time.
And now come the weird things. The maximum connection establishment rate
test was successful. The binary search was executed 10 times without any
problem. As for the throughput test, the binary search was done ones
fully. (It means 9 steps.)
Here is the first result:
No, Size, Dir, n, m, Duration, Initial Rate, N, M, R, T, D, Error, Date,
Iterations needed, rate
1, 84, b, 2, 2, 60, 20, 400, 400, 8, 500, 51000, 1000,
2023-09-03 18:23:27, 9, 361718
root@tester:~/siitperf#
And when the binary search was executed the second time, it stopped
working after the
Re: I would like help matching my outgoing domains to the right IP for smtpd
On Wed, Aug 16, 2023 at 10:21:34AM +0200, Bruno Flückiger wrote: > How about something like this? > > match from mail-from regex "@example.net" action send_example_net > match from mail-from regex "@example.com" action send_example_com > > Cheers, > Bruno > Thank you very much. I just had to add for any and it works perfectly. My dad and I ate some bad food at a restaurant, so this is a happy moment. -- Chris Bennett
Re: I would like help matching my outgoing domains to the right IP for smtpd
On 11.08., Chris Bennett wrote: > On Sat, Aug 12, 2023 at 03:49:12AM +, Philipp Buehler wrote: > > Am 12.08.2023 03:13 schrieb Chris Bennett: > > > I can't figure out how to match the outgoing mails to the correct IP/mx > > > they are coming from. Just one server, different A records for the mx > > > versus domain name. > > > > Difficult to understand what you're trying there... > > I kinda understand that you have multiple IP-addresses on that smtpd > > machine and need to send from a "correct" one? > > If so, check back that 'action' with a relay delivery has a 'src' option. > > > > HTH, > > -- > > pb > > > action "benn_to_outbound" relay src 108.181.26.184 helo > mx.bennettconstruction.us > > If this is correct, it works fine. > However, right now, I am forcing a match with > > match from local for anyaction "benn_to_outbound" > > I haven't been able to think of a way to match each individual one. > > -- > Chris Bennett > How about something like this? match from mail-from regex "@example.net" action send_example_net match from mail-from regex "@example.com" action send_example_com Cheers, Bruno
Re: [cpb_m...@bennettconstruction.us: I would like help matching my outgoing domains to the right IP for smtpd]
It's the weekend. I will see if anyone has any advice later. I will spend my time looking at perhaps solving the problem with a filter and using tcpdump and the debug features of smtpd to follow what I come up with. -- Chris Bennett
Re: I would like help matching my outgoing domains to the right IP for smtpd
On Sat, Aug 12, 2023 at 03:49:12AM +, Philipp Buehler wrote: > Am 12.08.2023 03:13 schrieb Chris Bennett: > > I can't figure out how to match the outgoing mails to the correct IP/mx > > they are coming from. Just one server, different A records for the mx > > versus domain name. > > Difficult to understand what you're trying there... > I kinda understand that you have multiple IP-addresses on that smtpd > machine and need to send from a "correct" one? > If so, check back that 'action' with a relay delivery has a 'src' option. > > HTH, > -- > pb > action "benn_to_outbound" relay src 108.181.26.184 helo mx.bennettconstruction.us If this is correct, it works fine. However, right now, I am forcing a match with match from local for anyaction "benn_to_outbound" I haven't been able to think of a way to match each individual one. -- Chris Bennett
Re: I would like help matching my outgoing domains to the right IP for smtpd
On Sat, Aug 12, 2023 at 03:49:12AM +, Philipp Buehler wrote: > Am 12.08.2023 03:13 schrieb Chris Bennett: > > I can't figure out how to match the outgoing mails to the correct IP/mx > > they are coming from. Just one server, different A records for the mx > > versus domain name. > > Difficult to understand what you're trying there... > I kinda understand that you have multiple IP-addresses on that smtpd > machine and need to send from a "correct" one? > If so, check back that 'action' with a relay delivery has a 'src' option. > > HTH, > -- > pb > I have one server with multiple IP addresses. For example, bennettconstruction.us at one IP, with A record mx.bennettconstruction.us at the same machine, different IP with it's own A record. Plus, several other website and mail domains on the same server. In each case, each has it's own A record and IP, one for a domain name, the other for it's mail domain. bennettconstruction.us 1.2.3.4 mx.bennettconstruction.us 1.2.3.5 moron.org 1.2.3.6 mail.moron.org 1.2.3.7 wisecracker.com 1.2.3.8 mx.wisecracker.com 1.2.3.9 I'm trying to get the proper mail server to match the sent From: domain. Also, with this switch changing the hostname, root now comes through bennettconstruction.us instead of the other one that was the hostname before. The change in hostname was planned. In case it's relevant, I always use ssh and neomutt to the server for reading and sending. I only use K9 on my phone to read or click a link. Thank you for putting up with my hard to understand posts. It's not deliberate, but a lifelong problem. -- Chris Bennett
Re: I would like help matching my outgoing domains to the right IP for smtpd
Am 12.08.2023 03:13 schrieb Chris Bennett: I can't figure out how to match the outgoing mails to the correct IP/mx they are coming from. Just one server, different A records for the mx versus domain name. Difficult to understand what you're trying there... I kinda understand that you have multiple IP-addresses on that smtpd machine and need to send from a "correct" one? If so, check back that 'action' with a relay delivery has a 'src' option. HTH, -- pb
I would like help matching my outgoing domains to the right IP for smtpd
Hello, as I was updating to the new IP ranges, I changed ~all to -all (My old IP's were crap filled with spam, so I just didn't send mails to the big guys.) I tried sending to gmail.com and got smacked that the spf was referring to an unexpected address on the server. I found that I was getting "random" choices from the tables I had setup. Reading the manpage carefully, I saw that this was the correct behaviour. If the headers in this email are correct, then I have the right action. I can't figure out how to match the outgoing mails to the correct IP/mx they are coming from. Just one server, different A records for the mx versus domain name. Right now, I'm just forcing all local to this action. After several hours trying different options and testing sending to my other server, I'm coming up blank. Except that I now understand much more from the manpages that confused me previously. I've been reading a lot of other manpages lately, too. Time well spent. Any advice would be nice. -- Chris Bennett
[cpb_m...@bennettconstruction.us: I would like help matching my outgoing domains to the right IP for smtpd]
- Forwarded message from Chris Bennett - To: misc@openbsd.org From: Chris Bennett Subject: I would like help matching my outgoing domains to the right IP for smtpd Date: Fri, 11 Aug 2023 18:13:59 -0700 Hello, as I was updating to the new IP ranges, I changed ~all to -all (My old IP's were crap filled with spam, so I just didn't send mails to the big guys.) I tried sending to gmail.com and got smacked that the spf was referring to an unexpected address on the server. I found that I was getting "random" choices from the tables I had setup. Reading the manpage carefully, I saw that this was the correct behaviour. If the headers in this email are correct, then I have the right action. I can't figure out how to match the outgoing mails to the correct IP/mx they are coming from. Just one server, different A records for the mx versus domain name. Right now, I'm just forcing all local to this action. After several hours trying different options and testing sending to my other server, I'm coming up blank. Except that I now understand much more from the manpages that confused me previously. I've been reading a lot of other manpages lately, too. Time well spent. Any advice would be nice. -- Chris Bennett - End forwarded message - --
Re: I need help to see if I can reboot new network OK. Wild misadventures with non-OpenBSD support and bad IPMI
On Sat, Jul 29, 2023 at 07:41:18PM +, Philipp Buehler wrote: > Am 29.07.2023 21:29 schrieb Chris Bennett: > > The other IP's are randomly missing or give this: > > > > link#2 UHLc 0 450 - 3 em1 > > Hi, I'm happy. I practiced on the other server until I was sure, then I changed the first server over to the new way. I got one link#2 on the last IP, so I aliased that one in too and rebooted. Everything is great. What does link#2 mean in a more literal sense? Tomorrow all I have to do is new DNS records and swap the IP addresses for the other server. Tell them to switch me over to the new IP's and I'm done. I have no idea what the network problem was, but I leave my desktop on 24/7. It crashed for the first time ever. Most likely it was the problem. Thank you for the education. I fully approve of getting little pieces at a time. Change this. Doesn't work. Study it carefully. Post again. More problems. Then more help. I have always liked OpenBSD's policy of not giving information to just copy/paste. Now I need to go make a donation. Have a great day. -- Chris
Re: I need help to see if I can reboot new network OK. Wild misadventures with non-OpenBSD support and bad IPMI
On Sat, Jul 29, 2023 at 07:41:18PM +, Philipp Buehler wrote: > Oh, you need an alias for each IP that should be bound on em1 > so, like: > # cat /etc/hostname.em1 > inet 103.103.103.170/29 > inet alias 103.103.103.171/32 > inet alias 103.103.103.172/32 > inet alias 103.103.103.173/32 > inet alias 103.103.103.174/32 > This seemed to work. The network is very strange for me. Not sure if my hotspot is bad or if they are having network problems at the company. New network, new problems? I will get back later if this is a real problem or not. I was reading route manpage. Next is netstart script and manpage. Thanks. I really appreciate it. Chris Bennett > > mygate and netstart has a manpage, as there is 'hostname.if' to read :) > > PS: pointless to use '-x'; just a lot of debug noise > > -- > pb > --
Re: I need help to see if I can reboot new network OK. Wild misadventures with non-OpenBSD support and bad IPMI
Am 29.07.2023 21:29 schrieb Chris Bennett: The other IP's are randomly missing or give this: link#2 UHLc 0 450 - 3 em1 Each route flush;sh -x /etc/nestart or a reboot changes the result. Oh, you need an alias for each IP that should be bound on em1 so, like: # cat /etc/hostname.em1 inet 103.103.103.170/29 inet alias 103.103.103.171/32 inet alias 103.103.103.172/32 inet alias 103.103.103.173/32 inet alias 103.103.103.174/32 # cat /etc/mygate 103.103.103.169 mygate and netstart has a manpage, as there is 'hostname.if' to read :) PS: pointless to use '-x'; just a lot of debug noise -- pb
Re: I need help to see if I can reboot new network OK. Wild misadventures with non-OpenBSD support and bad IPMI
On Sat, Jul 29, 2023 at 06:18:40PM +, Philipp Buehler wrote: > Am 29.07.2023 20:04 schrieb Chris Bennett: > > inet 103.103.103.168/29 > > That's wrong, you put the "first" IP-address you want to > use/have on em1. So that would be 170/29 > Well, that half-worked. Always get ...170, works. ssh works. autossh with -M no longer works except with autossh -M 0 ...169 is the gateway. ...175 is broadcast. The other IP's are randomly missing or give this: link#2 UHLc 0 450 - 3 em1 Each route flush;sh -x /etc/nestart or a reboot changes the result. I just tried mygate at ...174. No good. > (168 is this network's BSD-broadcast or "net address") > > > > /etc/mygate is > > 103.103.103.169 > Cannot forsee what your ISP provides as the gateway, but > likely that's correct. > Feel free to offer me a good man page to start with. Coffee is working. -- Chris Bennett
Re: I need help to see if I can reboot new network OK. Wild misadventures with non-OpenBSD support and bad IPMI
Am 29.07.2023 20:04 schrieb Chris Bennett: inet 103.103.103.168/29 That's wrong, you put the "first" IP-address you want to use/have on em1. So that would be 170/29 (168 is this network's BSD-broadcast or "net address") /etc/mygate is 103.103.103.169 Cannot forsee what your ISP provides as the gateway, but likely that's correct. All names (hosts,myname) is not directly relevant to IP networking. Do not put names in mygate (just a sidenote). ifconfig gave 103.103.103.168 as the IP address route -n show gave 103.103.103.168 as the gateway. Likely a config from the errornous hostname.if entry, see above. I did not change or remove what's in /etc/hostname which is at 103.103.103.170. Does that matter? hosts I assume? That might be relevant to apache, but not the networking (reachability) itself. -- pb
Re: I need help to see if I can reboot new network OK. Wild misadventures with non-OpenBSD support and bad IPMI
On Sat, Jul 29, 2023 at 04:34:17AM +, Philipp Buehler wrote: > > To save mindboggling counting of 'f' or similar, just write this to > /etc/hostname.em1 > inet 108.181.26.178/28 > The ifconfig called from netstart will figure it out ;-) That's a headups > for everybody, so cc misc@. > Hmm, I also have a newer server with the same company that does have a usable IPMI. I also have to change IP's with it too. It is running -current from a few weeks ago, so this is a fictional address except for the last three digits (168) 103.103.103.168/29 Right now, I have my first IP I'm using at 103.103.103.170 I put into /etc/hostname.em1: inet 103.103.103.168/29 /etc/mygate is 103.103.103.169 /etc/myname is network-moron.com I did not change /etc/hosts which just has the addresses from 103.103.103.170 to 103.103.103.175 added. I rebooted, but couldn't ping the server at any address. In IPMI, there were no network problems on the boot screen, but apache2 failed to start. ifconfig gave 103.103.103.168 as the IP address route -n show gave 103.103.103.168 as the gateway. For the heck of it, I changed /etc/mygate to 103.103.103.168, just to see if that provided any useful information. Same failed outcome, as I expected. .later I tried every obvious variation I could think of. Nothing works except what I used on the other server. A couple of years ago I tried to do what you suggested with a script to swap back in the old hostname and reboot. I couldn't ever get it to work Since what I had worked (not what I really wanted to use with the aliases), I just blew it off. I took a good while with my brain in sludge mode last night to change some essential passwords and shut off imap, etc. I still lacking enough sleep. Having coffee, going to eat and probably go back to bed. I just wanted to try this out while I could. I wanted to post about this and then RTFM's later with a clear head. I did not change or remove what's in /etc/hostname which is at 103.103.103.170. Does that matter? -- Chris Bennett
