On Sunday, 19 February 2017 at 09:21:40 UTC, aberba wrote:
On Sunday, 19 February 2017 at 08:01:56 UTC, dummy wrote:
[...]

You can use any D lib with http GET support (Vibe.d[1]: download, requests[2]) at code.dlang.org. arsd.dom[3] has dom parsing support. or use any XML lib.

[1] http://code.dlang.org/packages/vibe-d
[2] http://code.dlang.org/packages/requests
[3] http://code.dlang.org/packages/arsd

The expiremental XML lib too has nice API (https://lodo1995.github.io/experimental.xml/std/experimental/xml/dom/Document.html)

I recommend requests and experimental DOM lib (http://code.dlang.org/packages/std-experimental-xml) to implement crawling.

'requests' looks like very useful! Thank you so much!

Reply via email to