Re: [lftp] torrent sharing
I need the full debug from the server an a client with timestamps (use debug -t). On пн, 18 сент. 2017, 6:28 Alexander Lukyanov wrote: > You can run the torrent in background to enter other commands. And BTW > lftp doesn't use threads. > > On пн, 18 сент. 2017, 6:20 Stu Midgley wrote: > >> Morning >> >> Thanks for taking time with this. >> >> How do I type the jobs -vv in? All the terminals are waiting in the >> torrent command (to receive the files) >> >> I also notice a LOT of DHT timeouts on almost every node I'm testing >> with... some are to the dht-bootstrap, but most are to the other lftp >> torrent clients. >> >> >> DHT node [172.16.250.22]:6881 has lost 2 packets >> >> >> >> >> >> initrd2 >> >> >> DHT request get_peers to [172.16.250.22]:6881 timed out >> >> DHT node [172.16.250.22]:6881 has lost 3 packets >> >> >> >> >> >> >> initrd2: dn:0 up:0 >> >> DHT request find_node to [172.16.250.33]:6882 timed out >> >> DHT node [172.16.250.33]:6882 has lost 1 packets >> >> DHT request find_node to [172.16.250.182]:6886 timed out >> >> DHT node [172.16.250.182]:6886 has lost 1 packets >> >> >> Something is not right. After quite some time (10+ minutes) clients >> suddenly start downloading the files and also seeding. BUT it takes over >> 10 minutes to get into that state. I feel their is a critical thread >> somewhere stuck and it eventually timeouts. >> >> Thanks >> Stuart. >> >> >> >> >> On Sun, Sep 17, 2017 at 7:25 PM, Alexander Lukyanov >> wrote: >> >>> Try "jobs -vv" to see the peer status. >>> >>> On пт, 15 сент. 2017, 8:15 Stu Midgley wrote: >>> OK... getting further along. It turns out that I had to delete the lftp cache so that the nodes didn't all have the same node_id (from ip address 127.0.0.1). I now * remove the tests for 172.16 ip addresses in both lftp and dht-bootstrap * specify the torret:ip as the host ip * delete the lftp cache (~/.cache/lftp) However, no data is transfered. On the client I get torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 seeds) On the server I get torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 seeds) I can see the communication with the dht-bootstrap server and that looks good. I can also see the client and server sending each other dht get_peers and getting a response. Stu. -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp >>> >> >> >> -- >> Dr Stuart Midgley >> sdm...@gmail.com >> > ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
You can run the torrent in background to enter other commands. And BTW lftp doesn't use threads. On пн, 18 сент. 2017, 6:20 Stu Midgley wrote: > Morning > > Thanks for taking time with this. > > How do I type the jobs -vv in? All the terminals are waiting in the > torrent command (to receive the files) > > I also notice a LOT of DHT timeouts on almost every node I'm testing > with... some are to the dht-bootstrap, but most are to the other lftp > torrent clients. > > > DHT node [172.16.250.22]:6881 has lost 2 packets > > > > > > initrd2 > > > DHT request get_peers to [172.16.250.22]:6881 timed out > > DHT node [172.16.250.22]:6881 has lost 3 packets > > > > > > > initrd2: dn:0 up:0 > > DHT request find_node to [172.16.250.33]:6882 timed out > > DHT node [172.16.250.33]:6882 has lost 1 packets > > DHT request find_node to [172.16.250.182]:6886 timed out > > DHT node [172.16.250.182]:6886 has lost 1 packets > > > Something is not right. After quite some time (10+ minutes) clients > suddenly start downloading the files and also seeding. BUT it takes over > 10 minutes to get into that state. I feel their is a critical thread > somewhere stuck and it eventually timeouts. > > Thanks > Stuart. > > > > > On Sun, Sep 17, 2017 at 7:25 PM, Alexander Lukyanov > wrote: > >> Try "jobs -vv" to see the peer status. >> >> On пт, 15 сент. 2017, 8:15 Stu Midgley wrote: >> >>> OK... getting further along. It turns out that I had to delete the lftp >>> cache so that the nodes didn't all have the same node_id (from ip address >>> 127.0.0.1). >>> >>> I now >>> * remove the tests for 172.16 ip addresses in both lftp and >>> dht-bootstrap >>> * specify the torret:ip as the host ip >>> * delete the lftp cache (~/.cache/lftp) >>> >>> However, no data is transfered. >>> >>> On the client I get >>> >>> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >>> (1 seeds) >>> >>> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >>> (1 seeds) >>> >>> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >>> (1 seeds) >>> >>> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >>> (1 seeds) >>> >>> On the server I get >>> >>> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >>> (0 seeds) >>> >>> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >>> (0 seeds) >>> >>> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >>> (0 seeds) >>> >>> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >>> (0 seeds) >>> >>> >>> I can see the communication with the dht-bootstrap server and that >>> looks good. >>> >>> I can also see the client and server sending each other dht get_peers >>> and getting a response. >>> >>> Stu. >>> >>> >>> -- >>> Dr Stuart Midgley >>> sdm...@gmail.com >>> ___ >>> lftp mailing list >>> lftp@uniyar.ac.ru >>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp >>> >> > > > -- > Dr Stuart Midgley > sdm...@gmail.com > ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
Morning Thanks for taking time with this. How do I type the jobs -vv in? All the terminals are waiting in the torrent command (to receive the files) I also notice a LOT of DHT timeouts on almost every node I'm testing with... some are to the dht-bootstrap, but most are to the other lftp torrent clients. DHT node [172.16.250.22]:6881 has lost 2 packets initrd2 DHT request get_peers to [172.16.250.22]:6881 timed out DHT node [172.16.250.22]:6881 has lost 3 packets initrd2: dn:0 up:0 DHT request find_node to [172.16.250.33]:6882 timed out DHT node [172.16.250.33]:6882 has lost 1 packets DHT request find_node to [172.16.250.182]:6886 timed out DHT node [172.16.250.182]:6886 has lost 1 packets Something is not right. After quite some time (10+ minutes) clients suddenly start downloading the files and also seeding. BUT it takes over 10 minutes to get into that state. I feel their is a critical thread somewhere stuck and it eventually timeouts. Thanks Stuart. On Sun, Sep 17, 2017 at 7:25 PM, Alexander Lukyanov wrote: > Try "jobs -vv" to see the peer status. > > On пт, 15 сент. 2017, 8:15 Stu Midgley wrote: > >> OK... getting further along. It turns out that I had to delete the lftp >> cache so that the nodes didn't all have the same node_id (from ip address >> 127.0.0.1). >> >> I now >> * remove the tests for 172.16 ip addresses in both lftp and dht-bootstrap >> * specify the torret:ip as the host ip >> * delete the lftp cache (~/.cache/lftp) >> >> However, no data is transfered. >> >> On the client I get >> >> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >> (1 seeds) >> >> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >> (1 seeds) >> >> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >> (1 seeds) >> >> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >> (1 seeds) >> >> On the server I get >> >> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >> (0 seeds) >> >> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >> (0 seeds) >> >> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >> (0 seeds) >> >> torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers >> (0 seeds) >> >> >> I can see the communication with the dht-bootstrap server and that looks >> good. >> >> I can also see the client and server sending each other dht get_peers and >> getting a response. >> >> Stu. >> >> >> -- >> Dr Stuart Midgley >> sdm...@gmail.com >> ___ >> lftp mailing list >> lftp@uniyar.ac.ru >> http://univ.uniyar.ac.ru/mailman/listinfo/lftp >> > -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
Try "jobs -vv" to see the peer status. On пт, 15 сент. 2017, 8:15 Stu Midgley wrote: > OK... getting further along. It turns out that I had to delete the lftp > cache so that the nodes didn't all have the same node_id (from ip address > 127.0.0.1). > > I now > * remove the tests for 172.16 ip addresses in both lftp and dht-bootstrap > * specify the torret:ip as the host ip > * delete the lftp cache (~/.cache/lftp) > > However, no data is transfered. > > On the client I get > > torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 > seeds) > > torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 > seeds) > > torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 > seeds) > > torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 > seeds) > > On the server I get > > torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 > seeds) > > torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 > seeds) > > torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 > seeds) > > torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 > seeds) > > > I can see the communication with the dht-bootstrap server and that looks > good. > > I can also see the client and server sending each other dht get_peers and > getting a response. > > Stu. > > > -- > Dr Stuart Midgley > sdm...@gmail.com > ___ > lftp mailing list > lftp@uniyar.ac.ru > http://univ.uniyar.ac.ru/mailman/listinfo/lftp > ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
OK... getting further along. It turns out that I had to delete the lftp cache so that the nodes didn't all have the same node_id (from ip address 127.0.0.1). I now * remove the tests for 172.16 ip addresses in both lftp and dht-bootstrap * specify the torret:ip as the host ip * delete the lftp cache (~/.cache/lftp) However, no data is transfered. On the client I get torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1 seeds) On the server I get torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 seeds) torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0 seeds) I can see the communication with the dht-bootstrap server and that looks good. I can also see the client and server sending each other dht get_peers and getting a response. Stu. -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
I'm still struggling to get this working... I think lftp is computing the same node id for all the nodes? starting search for 7AF61DD571566B9076B64DC85E98483A13731943 too few good nodes found in the routing table 1/8 search for 7AF61DD571566B9076B64DC85E98483A13731943 continues on 363FFE697351FF4AEC29CDBAABF2FBE3467CC267 ([172.16.250.40]:6881) depth=0 ---> sending DHT find_node to [172.16.250.40]:6881 {"a":{"want":["n4", "n6"], "target":"", "id":""}, "q":"find_node", "y":"q", "t":""} <--- received DHT response from [172.16.250.40]:6881 {"r":{"nodes6":"", "nodes":"", "id":""}, "ip":"", "y":"r", "t":""} got reply for find_node with target 7AF61DD571566B9076B64DC85E98483A13731943 from node 363FFE697351FF4AEC29CDBAABF2FBE3467CC267 search for 7AF61DD571566B9076B64DC85E98483A13731943 goes to depth=1 with best_node_id=363FFE697351FF4AEC29CDBAABF2FBE3467CC267 adding 3 nodes node [172.16.250.40]:6885 has our own id 7AF61DD571566B9076B64DC85E98483A13731943 node [172.16.250.182]:6883 has our own id 7AF61DD571566B9076B64DC85E98483A13731943 node [172.16.250.40]:6885 has our own id 7AF61DD571566B9076B64DC85E98483A13731943 adding 0 nodes6 On Thu, Sep 14, 2017 at 10:13 PM, Stu Midgley wrote: > What I'm trying to do is use bittorrent for the booting of our cluster (to > get the 2GB image out to the compute nodes). The idea being that the nodes > can feed each other parts of the image rather than all of them trying to > download it from a single (or small number) of servers. > > Thanks. > > On Thu, Sep 14, 2017 at 10:11 PM, Stu Midgley wrote: > >> That would be great, thanks. >> >> On Thu, Sep 14, 2017 at 10:05 PM, Alexander V. Lukyanov >> wrote: >> >>> On Thu, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote: >>> > and of course... their was a similar test in dht-bootstrap . >>> > >>> > I have removed both tests and they at least talk to each other. >>> >>> I think I'll make a new setting allowing DHT and bittorrent to private >>> networks (off by default). >>> >>> -- >>>Alexander. >>> >>> > On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley wrote: >>> > >>> > > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc >>> > > >>> > > I modified the is_private function in network.cc to >>> > > >>> > > bool sockaddr_u::is_private() const >>> > > >>> > > { >>> > > >>> > >if(sa.sa_family==AF_INET) >>> > > >>> > >{ >>> > > >>> > > unsigned char *a=(unsigned char *)&in.sin_addr; >>> > > >>> > > return (0==1); >>> > > >>> > >} >>> > > >>> > > #if INET6 >>> > > >>> > >if(family()==AF_INET6) { >>> > > >>> > > return IN6_IS_ADDR_SITELOCAL(&in6.sin6_addr) >>> > > >>> > > || IN6_IS_ADDR_LINKLOCAL(&in6.sin6_addr); >>> > > >>> > >} >>> > > >>> > > #endif >>> > > >>> > >return false; >>> > > >>> > > } >>> > > >>> > > >>> > > >>> > > and it still didn't work. >>> > > >>> > > >>> > > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov >> > >>> > > wrote: >>> > > >>> > >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote: >>> > >> > Thanks for the quick response. >>> > >> > >>> > >> > I started the bootstrap-dht and the lftp client and server on the >>> single >>> > >> > machine (172.16.250.40) which is a machine without external >>> access to >>> > >> the >>> > >> > internet (hence why I want to run my own dht bootstrap service. >>> > >> ... >>> > >> > I don't see lftp contacting the bootstrap service. >>> > >> >>> > >> It appears that lftp refuses to talk DHT to private IP addresses >>> (see >>> > >> DHT.cc:296). I don't know if that's correct, but I was thinking >>> about >>> > >> security of private networks when I coded this. >>> > >> >>> > >> -- >>> > >>Alexander. >>> > >> >>> > > >>> > > >>> > > >>> > > -- >>> > > Dr Stuart Midgley >>> > > sdm...@gmail.com >>> > > >>> > >>> > >>> > >>> > -- >>> > Dr Stuart Midgley >>> > sdm...@gmail.com >>> >>> > ___ >>> > lftp mailing list >>> > lftp@uniyar.ac.ru >>> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp >>> >> >> >> >> -- >> Dr Stuart Midgley >> sdm...@gmail.com >> > > > > -- > Dr Stuart Midgley > sdm...@gmail.com > -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
What I'm trying to do is use bittorrent for the booting of our cluster (to get the 2GB image out to the compute nodes). The idea being that the nodes can feed each other parts of the image rather than all of them trying to download it from a single (or small number) of servers. Thanks. On Thu, Sep 14, 2017 at 10:11 PM, Stu Midgley wrote: > That would be great, thanks. > > On Thu, Sep 14, 2017 at 10:05 PM, Alexander V. Lukyanov > wrote: > >> On Thu, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote: >> > and of course... their was a similar test in dht-bootstrap . >> > >> > I have removed both tests and they at least talk to each other. >> >> I think I'll make a new setting allowing DHT and bittorrent to private >> networks (off by default). >> >> -- >>Alexander. >> >> > On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley wrote: >> > >> > > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc >> > > >> > > I modified the is_private function in network.cc to >> > > >> > > bool sockaddr_u::is_private() const >> > > >> > > { >> > > >> > >if(sa.sa_family==AF_INET) >> > > >> > >{ >> > > >> > > unsigned char *a=(unsigned char *)&in.sin_addr; >> > > >> > > return (0==1); >> > > >> > >} >> > > >> > > #if INET6 >> > > >> > >if(family()==AF_INET6) { >> > > >> > > return IN6_IS_ADDR_SITELOCAL(&in6.sin6_addr) >> > > >> > > || IN6_IS_ADDR_LINKLOCAL(&in6.sin6_addr); >> > > >> > >} >> > > >> > > #endif >> > > >> > >return false; >> > > >> > > } >> > > >> > > >> > > >> > > and it still didn't work. >> > > >> > > >> > > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov >> > > wrote: >> > > >> > >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote: >> > >> > Thanks for the quick response. >> > >> > >> > >> > I started the bootstrap-dht and the lftp client and server on the >> single >> > >> > machine (172.16.250.40) which is a machine without external access >> to >> > >> the >> > >> > internet (hence why I want to run my own dht bootstrap service. >> > >> ... >> > >> > I don't see lftp contacting the bootstrap service. >> > >> >> > >> It appears that lftp refuses to talk DHT to private IP addresses (see >> > >> DHT.cc:296). I don't know if that's correct, but I was thinking about >> > >> security of private networks when I coded this. >> > >> >> > >> -- >> > >>Alexander. >> > >> >> > > >> > > >> > > >> > > -- >> > > Dr Stuart Midgley >> > > sdm...@gmail.com >> > > >> > >> > >> > >> > -- >> > Dr Stuart Midgley >> > sdm...@gmail.com >> >> > ___ >> > lftp mailing list >> > lftp@uniyar.ac.ru >> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp >> > > > > -- > Dr Stuart Midgley > sdm...@gmail.com > -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
That would be great, thanks. On Thu, Sep 14, 2017 at 10:05 PM, Alexander V. Lukyanov wrote: > On Thu, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote: > > and of course... their was a similar test in dht-bootstrap . > > > > I have removed both tests and they at least talk to each other. > > I think I'll make a new setting allowing DHT and bittorrent to private > networks (off by default). > > -- >Alexander. > > > On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley wrote: > > > > > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc > > > > > > I modified the is_private function in network.cc to > > > > > > bool sockaddr_u::is_private() const > > > > > > { > > > > > >if(sa.sa_family==AF_INET) > > > > > >{ > > > > > > unsigned char *a=(unsigned char *)&in.sin_addr; > > > > > > return (0==1); > > > > > >} > > > > > > #if INET6 > > > > > >if(family()==AF_INET6) { > > > > > > return IN6_IS_ADDR_SITELOCAL(&in6.sin6_addr) > > > > > > || IN6_IS_ADDR_LINKLOCAL(&in6.sin6_addr); > > > > > >} > > > > > > #endif > > > > > >return false; > > > > > > } > > > > > > > > > > > > and it still didn't work. > > > > > > > > > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov > > > wrote: > > > > > >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote: > > >> > Thanks for the quick response. > > >> > > > >> > I started the bootstrap-dht and the lftp client and server on the > single > > >> > machine (172.16.250.40) which is a machine without external access > to > > >> the > > >> > internet (hence why I want to run my own dht bootstrap service. > > >> ... > > >> > I don't see lftp contacting the bootstrap service. > > >> > > >> It appears that lftp refuses to talk DHT to private IP addresses (see > > >> DHT.cc:296). I don't know if that's correct, but I was thinking about > > >> security of private networks when I coded this. > > >> > > >> -- > > >>Alexander. > > >> > > > > > > > > > > > > -- > > > Dr Stuart Midgley > > > sdm...@gmail.com > > > > > > > > > > > -- > > Dr Stuart Midgley > > sdm...@gmail.com > > > ___ > > lftp mailing list > > lftp@uniyar.ac.ru > > http://univ.uniyar.ac.ru/mailman/listinfo/lftp > -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
On Thu, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote: > and of course... their was a similar test in dht-bootstrap . > > I have removed both tests and they at least talk to each other. I think I'll make a new setting allowing DHT and bittorrent to private networks (off by default). -- Alexander. > On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley wrote: > > > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc > > > > I modified the is_private function in network.cc to > > > > bool sockaddr_u::is_private() const > > > > { > > > >if(sa.sa_family==AF_INET) > > > >{ > > > > unsigned char *a=(unsigned char *)&in.sin_addr; > > > > return (0==1); > > > >} > > > > #if INET6 > > > >if(family()==AF_INET6) { > > > > return IN6_IS_ADDR_SITELOCAL(&in6.sin6_addr) > > > > || IN6_IS_ADDR_LINKLOCAL(&in6.sin6_addr); > > > >} > > > > #endif > > > >return false; > > > > } > > > > > > > > and it still didn't work. > > > > > > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov > > wrote: > > > >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote: > >> > Thanks for the quick response. > >> > > >> > I started the bootstrap-dht and the lftp client and server on the single > >> > machine (172.16.250.40) which is a machine without external access to > >> the > >> > internet (hence why I want to run my own dht bootstrap service. > >> ... > >> > I don't see lftp contacting the bootstrap service. > >> > >> It appears that lftp refuses to talk DHT to private IP addresses (see > >> DHT.cc:296). I don't know if that's correct, but I was thinking about > >> security of private networks when I coded this. > >> > >> -- > >>Alexander. > >> > > > > > > > > -- > > Dr Stuart Midgley > > sdm...@gmail.com > > > > > > -- > Dr Stuart Midgley > sdm...@gmail.com > ___ > lftp mailing list > lftp@uniyar.ac.ru > http://univ.uniyar.ac.ru/mailman/listinfo/lftp ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
and of course... their was a similar test in dht-bootstrap . I have removed both tests and they at least talk to each other. On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley wrote: > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc > > I modified the is_private function in network.cc to > > bool sockaddr_u::is_private() const > > { > >if(sa.sa_family==AF_INET) > >{ > > unsigned char *a=(unsigned char *)&in.sin_addr; > > return (0==1); > >} > > #if INET6 > >if(family()==AF_INET6) { > > return IN6_IS_ADDR_SITELOCAL(&in6.sin6_addr) > > || IN6_IS_ADDR_LINKLOCAL(&in6.sin6_addr); > >} > > #endif > >return false; > > } > > > > and it still didn't work. > > > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov > wrote: > >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote: >> > Thanks for the quick response. >> > >> > I started the bootstrap-dht and the lftp client and server on the single >> > machine (172.16.250.40) which is a machine without external access to >> the >> > internet (hence why I want to run my own dht bootstrap service. >> ... >> > I don't see lftp contacting the bootstrap service. >> >> It appears that lftp refuses to talk DHT to private IP addresses (see >> DHT.cc:296). I don't know if that's correct, but I was thinking about >> security of private networks when I coded this. >> >> -- >>Alexander. >> > > > > -- > Dr Stuart Midgley > sdm...@gmail.com > -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc I modified the is_private function in network.cc to bool sockaddr_u::is_private() const { if(sa.sa_family==AF_INET) { unsigned char *a=(unsigned char *)&in.sin_addr; return (0==1); } #if INET6 if(family()==AF_INET6) { return IN6_IS_ADDR_SITELOCAL(&in6.sin6_addr) || IN6_IS_ADDR_LINKLOCAL(&in6.sin6_addr); } #endif return false; } and it still didn't work. On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov wrote: > On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote: > > Thanks for the quick response. > > > > I started the bootstrap-dht and the lftp client and server on the single > > machine (172.16.250.40) which is a machine without external access to the > > internet (hence why I want to run my own dht bootstrap service. > ... > > I don't see lftp contacting the bootstrap service. > > It appears that lftp refuses to talk DHT to private IP addresses (see > DHT.cc:296). I don't know if that's correct, but I was thinking about > security of private networks when I coded this. > > -- >Alexander. > -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote: > Thanks for the quick response. > > I started the bootstrap-dht and the lftp client and server on the single > machine (172.16.250.40) which is a machine without external access to the > internet (hence why I want to run my own dht bootstrap service. ... > I don't see lftp contacting the bootstrap service. It appears that lftp refuses to talk DHT to private IP addresses (see DHT.cc:296). I don't know if that's correct, but I was thinking about security of private networks when I coded this. -- Alexander. ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
Thanks for the quick response. I started the bootstrap-dht and the lftp client and server on the single machine (172.16.250.40) which is a machine without external access to the internet (hence why I want to run my own dht bootstrap service. The dht bootstrap service is running on port 6881. Here is the server session > lftp -d lftp :~> set torrent:use-dht yes lftp :~> torrent --dht-bootstrap=172.16.250.40 listening on udp [::]:6887 listening on udp [0.0.0.0]:6887 Resolving host address... 1 address found: 172.16.250.40 lftp :~> torrent --share image.tar.gz Total length is 2146267992 opening image.tar.gz closing image.tar.gz Piece length is 1048576 Total length is 2146267992 magnet:?xt=urn:btih:B40B0E478CB94A69CE6A3E811744D09AA7F60D31&xl=2146267992&dn=image.tar.gz listening on tcp [0.0.0.0]:6887 starting search for B40B0E478CB94A69CE6A3E811744D09AA7F60D31 too few good nodes found in the routing table no nodes found in the routing table starting search for B40B0E478CB94A69CE6A3E811744D09AA7F60D31 too few good nodes found in the routing table no nodes found in the routing table listening on tcp [::]:6887 opening image.tar.gz closing image.tar.gz image.tar.gz: dn:0 up:0 complete, ratio:0.00/0.00/0.00 What isn't show here is the validation of the image.tar.gz that went on. Here is the client session > lftp -d lftp :~> set torrent:use-dht yes lftp :~> torrent --dht-bootstrap=172.16.250.40 listening on udp [::]:6882 listening on udp [0.0.0.0]:6883 Resolving host address... 1 address found: 172.16.250.40 lftp :~> torrent 'magnet:?xt=urn:btih:B40B0E478CB94A69CE6A3E811744D09AA7F60D31&xl=2146267992&dn=image.tar.gz' listening on tcp [0.0.0.0]:6883 listening on tcp [::]:6883 starting search for B40B0E478CB94A69CE6A3E811744D09AA7F60D31 too few good nodes found in the routing table no nodes found in the routing table starting search for B40B0E478CB94A69CE6A3E811744D09AA7F60D31 too few good nodes found in the routing table no nodes found in the routing table image.tar.gz: Waiting for meta-data... I don't see lftp contacting the bootstrap service. Stu. > I recommend turning on debug in lftp before this command and see how > bootstrapping goes. Maybe it's a port mismatch problem. lftp uses 6881 by > default. > > Do you really need your own bootstrapper service? I can usually bootstrap > from one of: dht.transmissionbt.com, router.utorrent.com, > router.bittorrent.com. > > -- >Alexander. > -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] torrent sharing
On Thu, Sep 14, 2017 at 03:56:39PM +0800, Stu Midgley wrote: > Afternoon > > I've been trying to get lftp to share a directory to a torrent and then > download it via the torrent on another machine. > > Unfortunately, I haven't had any success. > > on machine1, I have setup and installed bootstrap-dht from > > https://github.com/bittorrent/bootstrap-dht > > and then from machine2 I then run lftp and issue > > set torrent:use-dht yes > torrent --dht-bootstrape=machine1 I recommend turning on debug in lftp before this command and see how bootstrapping goes. Maybe it's a port mismatch problem. lftp uses 6881 by default. Do you really need your own bootstrapper service? I can usually bootstrap from one of: dht.transmissionbt.com, router.utorrent.com, router.bittorrent.com. -- Alexander. ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
[lftp] torrent sharing
Afternoon I've been trying to get lftp to share a directory to a torrent and then download it via the torrent on another machine. Unfortunately, I haven't had any success. on machine1, I have setup and installed bootstrap-dht from https://github.com/bittorrent/bootstrap-dht and then from machine2 I then run lftp and issue set torrent:use-dht yes torrent --dht-bootstrape=machine1 torrent --share mydir which prints out the magnet link. >From machine3 I then run lftp and issue set torrent:use-dht yes torrent --dht-bootstrape=machine1 torrent 'copy of magnet link' and I get the message Waiting for meta-data... and no files are downloaded. I've run tcpdump on machine1, machine2 and machine3 and I don't see any dht traffic at all. I've strace'd the dht server and it doesn't get any connections or traffic. None of the machines run a firewall. I feel like I'm doing something wrong... but I can't work it out. Thanks. -- Dr Stuart Midgley sdm...@gmail.com ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp