Hi friends, I've just uploaded a package containing some code that I've been using in my personal Emacs config for a while. It has commands and functions useful for retrieving web page content and processing it into Org-mode content.
For example, you can copy a URL to the clipboard or kill-ring, then run a command that downloads the page, isolates the "readable" content with eww-readable, converts it to Org-mode content with Pandoc, and displays it in an Org-mode buffer. Another command does all of that but inserts it as an Org entry instead of displaying it in a new buffer. So you can quickly and easily read a web page in an Org buffer, or insert a page's content as an entry into an Org buffer. You may also find the support functions useful in building your own commands. I haven't submitted it to MELPA yet; I'd like to get some feedback and testing before doing that, so if any of these look useful to you, please give it a test drive! Here's a list of the commands and functions: Commands + org-web-tools-insert-link-for-url: Insert an Org-mode link to the URL in the clipboard or kill-ring. Downloads the page to get the HTML title. + org-web-tools-insert-web-page-as-entry: Insert the web page for the URL in the clipboard or kill-ring as an Org-mode entry, as a sibling heading of the current entry. + org-web-tools-read-url-as-org: Display the web page for the URL in the clipboard or kill-ring as Org-mode text in a new buffer, processed with eww-readable. + org-web-tools-convert-url-list-to-page-entries: With point on a list of URLs in an Org-mode buffer, replace the list of URLs with a list of Org headings, each containing the web page content of that URL, converted to Org-mode text and processed with eww-readable. Functions + org-web-tools--eww-readable: Return "readable" part of HTML with title. + org-web-tools--get-url: Return content for URL as string. + org-web-tools--html-title: Return title of HTML page. + org-web-tools--html-to-org-with-pandoc: Return string of HTML converted to Org with Pandoc. + org-web-tools--url-as-readable-org: Return string containing Org entry of URLs web page content. Content is processed with eww-readable and Pandoc. Entry will be a top-level heading, with article contents below a second-level "Article" heading, and a timestamp in the first-level entry for writing comments. + org-web-tools--demote-headings-below: Demote all headings in buffer so the highest level is below LEVEL. + org-web-tools--get-first-url: Return URL in clipboard, or first URL in the kill-ring, or nil if none. + org-web-tools--read-org-bracket-link: Return (TARGET . DESCRIPTION) for Org bracket LINK or next link on current line. + org-web-tools--remove-dos-crlf: Remove all DOS CRLF (^M) in buffer. Thanks, Adam
