subject:"Re\: \[lftp\] torrent sharing"

Re: [lftp] torrent sharing

2017-09-17 Thread Alexander Lukyanov

I need the full debug from the server an a client with timestamps (use
debug -t).

On пн, 18 сент. 2017, 6:28 Alexander Lukyanov  wrote:

> You can run the torrent in background to enter other commands. And BTW
> lftp doesn't use threads.
>
> On пн, 18 сент. 2017, 6:20 Stu Midgley  wrote:
>
>> Morning
>>
>> Thanks for taking time with this.
>>
>> How do I type the jobs -vv in?  All the terminals are waiting in the
>> torrent command (to receive the files)
>>
>> I also notice a LOT of DHT timeouts on almost every node I'm testing
>> with...  some are to the dht-bootstrap, but most are to the other lftp
>> torrent clients.
>>
>>
>>  DHT node [172.16.250.22]:6881 has lost 2 packets
>>
>>
>>
>>
>>
>>   initrd2
>>
>>
>>  DHT request get_peers to [172.16.250.22]:6881 timed out
>>
>>  DHT node [172.16.250.22]:6881 has lost 3 packets
>>
>>
>>
>>
>>
>>
>> initrd2: dn:0 up:0
>>
>>  DHT request find_node to [172.16.250.33]:6882 timed out
>>
>>  DHT node [172.16.250.33]:6882 has lost 1 packets
>>
>>  DHT request find_node to [172.16.250.182]:6886 timed out
>>
>>  DHT node [172.16.250.182]:6886 has lost 1 packets
>>
>>
>> Something is not right.  After quite some time (10+ minutes) clients
>> suddenly start downloading the files and also seeding.  BUT it takes over
>> 10 minutes to get into that state.  I feel their is a critical thread
>> somewhere stuck and it eventually timeouts.
>>
>> Thanks
>> Stuart.
>>
>>
>>
>>
>> On Sun, Sep 17, 2017 at 7:25 PM, Alexander Lukyanov 
>> wrote:
>>
>>> Try "jobs -vv" to see the peer status.
>>>
>>> On пт, 15 сент. 2017, 8:15 Stu Midgley  wrote:
>>>
 OK... getting further along.  It turns out that I had to delete the
 lftp cache so that the nodes didn't all have the same node_id (from ip
 address 127.0.0.1).

 I now
  * remove the tests for 172.16 ip addresses in both lftp and
 dht-bootstrap
  * specify the torret:ip as the host ip
  * delete the lftp cache (~/.cache/lftp)

 However, no data is transfered.

 On the client I get

  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
 (1 seeds)

  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
 (1 seeds)

  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
 (1 seeds)

  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
 (1 seeds)

 On the server I get

  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
 (0 seeds)

  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
 (0 seeds)

  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
 (0 seeds)

  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
 (0 seeds)


 I can see the communication with the dht-bootstrap server and that
 looks good.

 I can also see the client and server sending each other dht get_peers
 and getting a response.

 Stu.


 --
 Dr Stuart Midgley
 sdm...@gmail.com
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp

>>>
>>
>>
>> --
>> Dr Stuart Midgley
>> sdm...@gmail.com
>>
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-17 Thread Alexander Lukyanov

You can run the torrent in background to enter other commands. And BTW lftp
doesn't use threads.

On пн, 18 сент. 2017, 6:20 Stu Midgley  wrote:

> Morning
>
> Thanks for taking time with this.
>
> How do I type the jobs -vv in?  All the terminals are waiting in the
> torrent command (to receive the files)
>
> I also notice a LOT of DHT timeouts on almost every node I'm testing
> with...  some are to the dht-bootstrap, but most are to the other lftp
> torrent clients.
>
>
>  DHT node [172.16.250.22]:6881 has lost 2 packets
>
>
>
>
>
> initrd2
>
>
>  DHT request get_peers to [172.16.250.22]:6881 timed out
>
>  DHT node [172.16.250.22]:6881 has lost 3 packets
>
>
>
>
>
>
> initrd2: dn:0 up:0
>
>  DHT request find_node to [172.16.250.33]:6882 timed out
>
>  DHT node [172.16.250.33]:6882 has lost 1 packets
>
>  DHT request find_node to [172.16.250.182]:6886 timed out
>
>  DHT node [172.16.250.182]:6886 has lost 1 packets
>
>
> Something is not right.  After quite some time (10+ minutes) clients
> suddenly start downloading the files and also seeding.  BUT it takes over
> 10 minutes to get into that state.  I feel their is a critical thread
> somewhere stuck and it eventually timeouts.
>
> Thanks
> Stuart.
>
>
>
>
> On Sun, Sep 17, 2017 at 7:25 PM, Alexander Lukyanov 
> wrote:
>
>> Try "jobs -vv" to see the peer status.
>>
>> On пт, 15 сент. 2017, 8:15 Stu Midgley  wrote:
>>
>>> OK... getting further along.  It turns out that I had to delete the lftp
>>> cache so that the nodes didn't all have the same node_id (from ip address
>>> 127.0.0.1).
>>>
>>> I now
>>>  * remove the tests for 172.16 ip addresses in both lftp and
>>> dht-bootstrap
>>>  * specify the torret:ip as the host ip
>>>  * delete the lftp cache (~/.cache/lftp)
>>>
>>> However, no data is transfered.
>>>
>>> On the client I get
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (1 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (1 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (1 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (1 seeds)
>>>
>>> On the server I get
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (0 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (0 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (0 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (0 seeds)
>>>
>>>
>>> I can see the communication with the dht-bootstrap server and that
>>> looks good.
>>>
>>> I can also see the client and server sending each other dht get_peers
>>> and getting a response.
>>>
>>> Stu.
>>>
>>>
>>> --
>>> Dr Stuart Midgley
>>> sdm...@gmail.com
>>> ___
>>> lftp mailing list
>>> lftp@uniyar.ac.ru
>>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>>
>>
>
>
> --
> Dr Stuart Midgley
> sdm...@gmail.com
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-17 Thread Stu Midgley

Morning

Thanks for taking time with this.

How do I type the jobs -vv in?  All the terminals are waiting in the
torrent command (to receive the files)

I also notice a LOT of DHT timeouts on almost every node I'm testing
with...  some are to the dht-bootstrap, but most are to the other lftp
torrent clients.


 DHT node [172.16.250.22]:6881 has lost 2 packets





initrd2


 DHT request get_peers to [172.16.250.22]:6881 timed out

 DHT node [172.16.250.22]:6881 has lost 3 packets






initrd2: dn:0 up:0

 DHT request find_node to [172.16.250.33]:6882 timed out

 DHT node [172.16.250.33]:6882 has lost 1 packets

 DHT request find_node to [172.16.250.182]:6886 timed out

 DHT node [172.16.250.182]:6886 has lost 1 packets


Something is not right.  After quite some time (10+ minutes) clients
suddenly start downloading the files and also seeding.  BUT it takes over
10 minutes to get into that state.  I feel their is a critical thread
somewhere stuck and it eventually timeouts.

Thanks
Stuart.




On Sun, Sep 17, 2017 at 7:25 PM, Alexander Lukyanov 
wrote:

> Try "jobs -vv" to see the peer status.
>
> On пт, 15 сент. 2017, 8:15 Stu Midgley  wrote:
>
>> OK... getting further along.  It turns out that I had to delete the lftp
>> cache so that the nodes didn't all have the same node_id (from ip address
>> 127.0.0.1).
>>
>> I now
>>  * remove the tests for 172.16 ip addresses in both lftp and dht-bootstrap
>>  * specify the torret:ip as the host ip
>>  * delete the lftp cache (~/.cache/lftp)
>>
>> However, no data is transfered.
>>
>> On the client I get
>>
>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>> (1 seeds)
>>
>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>> (1 seeds)
>>
>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>> (1 seeds)
>>
>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>> (1 seeds)
>>
>> On the server I get
>>
>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>> (0 seeds)
>>
>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>> (0 seeds)
>>
>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>> (0 seeds)
>>
>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>> (0 seeds)
>>
>>
>> I can see the communication with the dht-bootstrap server and that looks
>> good.
>>
>> I can also see the client and server sending each other dht get_peers and
>> getting a response.
>>
>> Stu.
>>
>>
>> --
>> Dr Stuart Midgley
>> sdm...@gmail.com
>> ___
>> lftp mailing list
>> lftp@uniyar.ac.ru
>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>
>


-- 
Dr Stuart Midgley
sdm...@gmail.com
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-17 Thread Alexander Lukyanov

Try "jobs -vv" to see the peer status.

On пт, 15 сент. 2017, 8:15 Stu Midgley  wrote:

> OK... getting further along.  It turns out that I had to delete the lftp
> cache so that the nodes didn't all have the same node_id (from ip address
> 127.0.0.1).
>
> I now
>  * remove the tests for 172.16 ip addresses in both lftp and dht-bootstrap
>  * specify the torret:ip as the host ip
>  * delete the lftp cache (~/.cache/lftp)
>
> However, no data is transfered.
>
> On the client I get
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
> seeds)
>
> On the server I get
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
> seeds)
>
>
> I can see the communication with the dht-bootstrap server and that looks
> good.
>
> I can also see the client and server sending each other dht get_peers and
> getting a response.
>
> Stu.
>
>
> --
> Dr Stuart Midgley
> sdm...@gmail.com
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-14 Thread Stu Midgley

OK... getting further along.  It turns out that I had to delete the lftp
cache so that the nodes didn't all have the same node_id (from ip address
127.0.0.1).

I now
 * remove the tests for 172.16 ip addresses in both lftp and dht-bootstrap
 * specify the torret:ip as the host ip
 * delete the lftp cache (~/.cache/lftp)

However, no data is transfered.

On the client I get

 torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
seeds)

 torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
seeds)

 torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
seeds)

 torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
seeds)

On the server I get

 torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
seeds)

 torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
seeds)

 torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
seeds)

 torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
seeds)


I can see the communication with the dht-bootstrap server and that looks
good.

I can also see the client and server sending each other dht get_peers and
getting a response.

Stu.


-- 
Dr Stuart Midgley
sdm...@gmail.com
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-14 Thread Stu Midgley

I'm still struggling to get this working...  I think lftp is computing the
same node id for all the nodes?

 starting search for 7AF61DD571566B9076B64DC85E98483A13731943

 too few good nodes found in the routing table 1/8

 search for 7AF61DD571566B9076B64DC85E98483A13731943 continues on
363FFE697351FF4AEC29CDBAABF2FBE3467CC267 ([172.16.250.40]:6881) depth=0

---> sending DHT find_node to [172.16.250.40]:6881 {"a":{"want":["n4",
"n6"], "target":"",
"id":""}, "q":"find_node",
"y":"q", "t":""}

<--- received DHT response from [172.16.250.40]:6881 {"r":{"nodes6":"",
"nodes":"",
"id":""},
"ip":"", "y":"r", "t":""}

 got reply for find_node with target
7AF61DD571566B9076B64DC85E98483A13731943 from node
363FFE697351FF4AEC29CDBAABF2FBE3467CC267

 search for 7AF61DD571566B9076B64DC85E98483A13731943 goes to depth=1
with best_node_id=363FFE697351FF4AEC29CDBAABF2FBE3467CC267

 adding 3 nodes

 node [172.16.250.40]:6885 has our own id
7AF61DD571566B9076B64DC85E98483A13731943

 node [172.16.250.182]:6883 has our own id
7AF61DD571566B9076B64DC85E98483A13731943

 node [172.16.250.40]:6885 has our own id
7AF61DD571566B9076B64DC85E98483A13731943

 adding 0 nodes6




On Thu, Sep 14, 2017 at 10:13 PM, Stu Midgley  wrote:

> What I'm trying to do is use bittorrent for the booting of our cluster (to
> get the 2GB image out to the compute nodes).  The idea being that the nodes
> can feed each other parts of the image rather than all of them trying to
> download it from a single (or small number) of servers.
>
> Thanks.
>
> On Thu, Sep 14, 2017 at 10:11 PM, Stu Midgley  wrote:
>
>> That would be great, thanks.
>>
>> On Thu, Sep 14, 2017 at 10:05 PM, Alexander V. Lukyanov 
>> wrote:
>>
>>> On Thu, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote:
>>> > and of course... their was a similar test in dht-bootstrap .
>>> >
>>> > I have removed both tests and they at least talk to each other.
>>>
>>> I think I'll make a new setting allowing DHT and bittorrent to private
>>> networks (off by default).
>>>
>>> --
>>>Alexander.
>>>
>>> > On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley  wrote:
>>> >
>>> > > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc
>>> > >
>>> > > I modified the is_private function in network.cc to
>>> > >
>>> > > bool sockaddr_u::is_private() const
>>> > >
>>> > > {
>>> > >
>>> > >if(sa.sa_family==AF_INET)
>>> > >
>>> > >{
>>> > >
>>> > >   unsigned char *a=(unsigned char *)_addr;
>>> > >
>>> > >   return (0==1);
>>> > >
>>> > >}
>>> > >
>>> > > #if INET6
>>> > >
>>> > >if(family()==AF_INET6) {
>>> > >
>>> > >   return IN6_IS_ADDR_SITELOCAL(_addr)
>>> > >
>>> > >   || IN6_IS_ADDR_LINKLOCAL(_addr);
>>> > >
>>> > >}
>>> > >
>>> > > #endif
>>> > >
>>> > >return false;
>>> > >
>>> > > }
>>> > >
>>> > >
>>> > >
>>> > > and it still didn't work.
>>> > >
>>> > >
>>> > > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov >> >
>>> > > wrote:
>>> > >
>>> > >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote:
>>> > >> > Thanks for the quick response.
>>> > >> >
>>> > >> > I started the bootstrap-dht and the lftp client and server on the
>>> single
>>> > >> > machine (172.16.250.40) which is a machine without external
>>> access to
>>> > >> the
>>> > >> > internet (hence why I want to run my own dht bootstrap service.
>>> > >> ...
>>> > >> > I don't see lftp contacting the bootstrap service.
>>> > >>
>>> > >> It appears that lftp refuses to talk DHT to private IP addresses
>>> (see
>>> > >> DHT.cc:296). I don't know if that's correct, but I was thinking
>>> about
>>> > >> security of private networks when I coded this.
>>> > >>
>>> > >> --
>>> > >>Alexander.
>>> > >>
>>> > >
>>> > >
>>> > >
>>> > > --
>>> > > Dr Stuart Midgley
>>> > > sdm...@gmail.com
>>> > >
>>> >
>>> >
>>> >
>>> > --
>>> > Dr Stuart Midgley
>>> > sdm...@gmail.com
>>>
>>> > ___
>>> > lftp mailing list
>>> > lftp@uniyar.ac.ru
>>> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>>
>>
>>
>>
>> --
>> Dr Stuart Midgley
>> sdm...@gmail.com
>>
>
>
>
> --
> Dr Stuart Midgley
> sdm...@gmail.com
>



-- 
Dr Stuart Midgley
sdm...@gmail.com
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-14 Thread Stu Midgley

What I'm trying to do is use bittorrent for the booting of our cluster (to
get the 2GB image out to the compute nodes).  The idea being that the nodes
can feed each other parts of the image rather than all of them trying to
download it from a single (or small number) of servers.

Thanks.

On Thu, Sep 14, 2017 at 10:11 PM, Stu Midgley  wrote:

> That would be great, thanks.
>
> On Thu, Sep 14, 2017 at 10:05 PM, Alexander V. Lukyanov 
> wrote:
>
>> On Thu, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote:
>> > and of course... their was a similar test in dht-bootstrap .
>> >
>> > I have removed both tests and they at least talk to each other.
>>
>> I think I'll make a new setting allowing DHT and bittorrent to private
>> networks (off by default).
>>
>> --
>>Alexander.
>>
>> > On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley  wrote:
>> >
>> > > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc
>> > >
>> > > I modified the is_private function in network.cc to
>> > >
>> > > bool sockaddr_u::is_private() const
>> > >
>> > > {
>> > >
>> > >if(sa.sa_family==AF_INET)
>> > >
>> > >{
>> > >
>> > >   unsigned char *a=(unsigned char *)_addr;
>> > >
>> > >   return (0==1);
>> > >
>> > >}
>> > >
>> > > #if INET6
>> > >
>> > >if(family()==AF_INET6) {
>> > >
>> > >   return IN6_IS_ADDR_SITELOCAL(_addr)
>> > >
>> > >   || IN6_IS_ADDR_LINKLOCAL(_addr);
>> > >
>> > >}
>> > >
>> > > #endif
>> > >
>> > >return false;
>> > >
>> > > }
>> > >
>> > >
>> > >
>> > > and it still didn't work.
>> > >
>> > >
>> > > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov 
>> > > wrote:
>> > >
>> > >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote:
>> > >> > Thanks for the quick response.
>> > >> >
>> > >> > I started the bootstrap-dht and the lftp client and server on the
>> single
>> > >> > machine (172.16.250.40) which is a machine without external access
>> to
>> > >> the
>> > >> > internet (hence why I want to run my own dht bootstrap service.
>> > >> ...
>> > >> > I don't see lftp contacting the bootstrap service.
>> > >>
>> > >> It appears that lftp refuses to talk DHT to private IP addresses (see
>> > >> DHT.cc:296). I don't know if that's correct, but I was thinking about
>> > >> security of private networks when I coded this.
>> > >>
>> > >> --
>> > >>Alexander.
>> > >>
>> > >
>> > >
>> > >
>> > > --
>> > > Dr Stuart Midgley
>> > > sdm...@gmail.com
>> > >
>> >
>> >
>> >
>> > --
>> > Dr Stuart Midgley
>> > sdm...@gmail.com
>>
>> > ___
>> > lftp mailing list
>> > lftp@uniyar.ac.ru
>> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>
>
>
>
> --
> Dr Stuart Midgley
> sdm...@gmail.com
>



-- 
Dr Stuart Midgley
sdm...@gmail.com
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-14 Thread Stu Midgley

That would be great, thanks.

On Thu, Sep 14, 2017 at 10:05 PM, Alexander V. Lukyanov 
wrote:

> On Thu, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote:
> > and of course... their was a similar test in dht-bootstrap .
> >
> > I have removed both tests and they at least talk to each other.
>
> I think I'll make a new setting allowing DHT and bittorrent to private
> networks (off by default).
>
> --
>Alexander.
>
> > On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley  wrote:
> >
> > > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc
> > >
> > > I modified the is_private function in network.cc to
> > >
> > > bool sockaddr_u::is_private() const
> > >
> > > {
> > >
> > >if(sa.sa_family==AF_INET)
> > >
> > >{
> > >
> > >   unsigned char *a=(unsigned char *)_addr;
> > >
> > >   return (0==1);
> > >
> > >}
> > >
> > > #if INET6
> > >
> > >if(family()==AF_INET6) {
> > >
> > >   return IN6_IS_ADDR_SITELOCAL(_addr)
> > >
> > >   || IN6_IS_ADDR_LINKLOCAL(_addr);
> > >
> > >}
> > >
> > > #endif
> > >
> > >return false;
> > >
> > > }
> > >
> > >
> > >
> > > and it still didn't work.
> > >
> > >
> > > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov 
> > > wrote:
> > >
> > >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote:
> > >> > Thanks for the quick response.
> > >> >
> > >> > I started the bootstrap-dht and the lftp client and server on the
> single
> > >> > machine (172.16.250.40) which is a machine without external access
> to
> > >> the
> > >> > internet (hence why I want to run my own dht bootstrap service.
> > >> ...
> > >> > I don't see lftp contacting the bootstrap service.
> > >>
> > >> It appears that lftp refuses to talk DHT to private IP addresses (see
> > >> DHT.cc:296). I don't know if that's correct, but I was thinking about
> > >> security of private networks when I coded this.
> > >>
> > >> --
> > >>Alexander.
> > >>
> > >
> > >
> > >
> > > --
> > > Dr Stuart Midgley
> > > sdm...@gmail.com
> > >
> >
> >
> >
> > --
> > Dr Stuart Midgley
> > sdm...@gmail.com
>
> > ___
> > lftp mailing list
> > lftp@uniyar.ac.ru
> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>



-- 
Dr Stuart Midgley
sdm...@gmail.com
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-14 Thread Alexander V. Lukyanov

On Thu, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote:
> and of course... their was a similar test in dht-bootstrap .
>
> I have removed both tests and they at least talk to each other.

I think I'll make a new setting allowing DHT and bittorrent to private
networks (off by default).

--
   Alexander.

> On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley  wrote:
>
> > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc
> >
> > I modified the is_private function in network.cc to
> >
> > bool sockaddr_u::is_private() const
> >
> > {
> >
> >if(sa.sa_family==AF_INET)
> >
> >{
> >
> >   unsigned char *a=(unsigned char *)_addr;
> >
> >   return (0==1);
> >
> >}
> >
> > #if INET6
> >
> >if(family()==AF_INET6) {
> >
> >   return IN6_IS_ADDR_SITELOCAL(_addr)
> >
> >   || IN6_IS_ADDR_LINKLOCAL(_addr);
> >
> >}
> >
> > #endif
> >
> >return false;
> >
> > }
> >
> >
> >
> > and it still didn't work.
> >
> >
> > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov 
> > wrote:
> >
> >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote:
> >> > Thanks for the quick response.
> >> >
> >> > I started the bootstrap-dht and the lftp client and server on the single
> >> > machine (172.16.250.40) which is a machine without external access to
> >> the
> >> > internet (hence why I want to run my own dht bootstrap service.
> >> ...
> >> > I don't see lftp contacting the bootstrap service.
> >>
> >> It appears that lftp refuses to talk DHT to private IP addresses (see
> >> DHT.cc:296). I don't know if that's correct, but I was thinking about
> >> security of private networks when I coded this.
> >>
> >> --
> >>Alexander.
> >>
> >
> >
> >
> > --
> > Dr Stuart Midgley
> > sdm...@gmail.com
> >
>
>
>
> --
> Dr Stuart Midgley
> sdm...@gmail.com

> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-14 Thread Stu Midgley

Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc

I modified the is_private function in network.cc to

bool sockaddr_u::is_private() const

{

   if(sa.sa_family==AF_INET)

   {

  unsigned char *a=(unsigned char *)_addr;

  return (0==1);

   }

#if INET6

   if(family()==AF_INET6) {

  return IN6_IS_ADDR_SITELOCAL(_addr)

  || IN6_IS_ADDR_LINKLOCAL(_addr);

   }

#endif

   return false;

}



and it still didn't work.


On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov  wrote:

> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote:
> > Thanks for the quick response.
> >
> > I started the bootstrap-dht and the lftp client and server on the single
> > machine (172.16.250.40) which is a machine without external access to the
> > internet (hence why I want to run my own dht bootstrap service.
> ...
> > I don't see lftp contacting the bootstrap service.
>
> It appears that lftp refuses to talk DHT to private IP addresses (see
> DHT.cc:296). I don't know if that's correct, but I was thinking about
> security of private networks when I coded this.
>
> --
>Alexander.
>



-- 
Dr Stuart Midgley
sdm...@gmail.com
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-14 Thread Alexander V. Lukyanov

On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote:
> Thanks for the quick response.
>
> I started the bootstrap-dht and the lftp client and server on the single
> machine (172.16.250.40) which is a machine without external access to the
> internet (hence why I want to run my own dht bootstrap service.
...
> I don't see lftp contacting the bootstrap service.

It appears that lftp refuses to talk DHT to private IP addresses (see
DHT.cc:296). I don't know if that's correct, but I was thinking about
security of private networks when I coded this.

--
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-14 Thread Stu Midgley

Thanks for the quick response.

I started the bootstrap-dht and the lftp client and server on the single
machine (172.16.250.40) which is a machine without external access to the
internet (hence why I want to run my own dht bootstrap service.

The dht bootstrap service is running on port 6881.


Here is the server session

> lftp -d

lftp :~> set torrent:use-dht yes

lftp :~> torrent --dht-bootstrap=172.16.250.40

 listening on udp [::]:6887

 listening on udp [0.0.0.0]:6887

 Resolving host address...

 1 address found: 172.16.250.40

lftp :~> torrent --share image.tar.gz

 Total length is 2146267992

 opening image.tar.gz

 closing image.tar.gz

 Piece length is 1048576

 Total length is 2146267992

magnet:?xt=urn:btih:B40B0E478CB94A69CE6A3E811744D09AA7F60D31=2146267992=image.tar.gz

 listening on tcp [0.0.0.0]:6887

 starting search for B40B0E478CB94A69CE6A3E811744D09AA7F60D31

 too few good nodes found in the routing table

 no nodes found in the routing table

 starting search for B40B0E478CB94A69CE6A3E811744D09AA7F60D31

 too few good nodes found in the routing table

 no nodes found in the routing table

 listening on tcp [::]:6887

 opening image.tar.gz

 closing image.tar.gz

image.tar.gz: dn:0 up:0 complete, ratio:0.00/0.00/0.00


What isn't show here is the validation of the image.tar.gz that went on.

Here is the client session

> lftp -d

lftp :~> set torrent:use-dht yes

lftp :~> torrent --dht-bootstrap=172.16.250.40

 listening on udp [::]:6882

 listening on udp [0.0.0.0]:6883

 Resolving host address...

 1 address found: 172.16.250.40

lftp :~> torrent
'magnet:?xt=urn:btih:B40B0E478CB94A69CE6A3E811744D09AA7F60D31=2146267992=image.tar.gz'

 listening on tcp [0.0.0.0]:6883

 listening on tcp [::]:6883

 starting search for B40B0E478CB94A69CE6A3E811744D09AA7F60D31

 too few good nodes found in the routing table

 no nodes found in the routing table

 starting search for B40B0E478CB94A69CE6A3E811744D09AA7F60D31

 too few good nodes found in the routing table

 no nodes found in the routing table

image.tar.gz: Waiting for meta-data...


I don't see lftp contacting the bootstrap service.

Stu.




> I recommend turning on debug in lftp before this command and see how
> bootstrapping goes. Maybe it's a port mismatch problem. lftp uses 6881 by
> default.
>
> Do you really need your own bootstrapper service? I can usually bootstrap
> from one of: dht.transmissionbt.com, router.utorrent.com,
> router.bittorrent.com.
>
> --
>Alexander.
>



-- 
Dr Stuart Midgley
sdm...@gmail.com
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

2017-09-14 Thread Alexander V. Lukyanov

On Thu, Sep 14, 2017 at 03:56:39PM +0800, Stu Midgley wrote:
> Afternoon
>
> I've been trying to get lftp to share a directory to a torrent and then
> download it via the torrent on another machine.
>
> Unfortunately, I haven't had any success.
>
> on machine1, I have setup and installed bootstrap-dht from
>
> https://github.com/bittorrent/bootstrap-dht
>
> and then from machine2 I then run lftp and issue
>
> set torrent:use-dht yes
> torrent --dht-bootstrape=machine1

I recommend turning on debug in lftp before this command and see how
bootstrapping goes. Maybe it's a port mismatch problem. lftp uses 6881 by
default.

Do you really need your own bootstrapper service? I can usually bootstrap
from one of: dht.transmissionbt.com, router.utorrent.com,
router.bittorrent.com.

--
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

Re: [lftp] torrent sharing

13 matches

Site Navigation

Mail list logo

Footer information