newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
Newspaper3k: Article scraping & curation ========================================
.. image:: https://badge.fury.io/py/newspaper3k.svg :target: http://badge.fury.io/py/newspaper3k.svg :alt: Latest version
.. image:: https://travis-ci.org/codelucas/newspaper.svg :target: http://travis-ci.org/codelucas/newspaper/ :alt: Build status
.. image:: https://coveralls.io/repos/github/codelucas/newspaper/badge.svg?branch=master :target: https://coveralls.io/github/codelucas/newspaper :alt: Coverage status
Inspired by requests for its simplicity and powered by lxml for its speed:
"Newspaper is an amazing python library for extracting & curating articles." -- tweeted by Kenneth Reitz, Author of requests
"Newspaper delivers Instapaper style article extraction." -- The Changelog_
.. _tweeted by: https://twitter.com/kennethreitz/status/419520678862548992 .. _The Changelog: http://thechangelog.com/newspaper-delivers-instapaper-style-article-extraction/
Newspaper is a Python3 library! Or, view our deprecated and buggy Python2 branch_
.. _Python2 branch: https://github.com/codelucas/newspaper/tree/python-2-head
A Glance:
.. code-block:: pycon
>>> from newspaper import Article
>>> url = 'http://fox13now.com/2013/12/30/new-year-new-laws-obamacare-pot-guns-and-drones/' >>> article = Article(url)
.. code-block:: pycon
>>> article.download()
>>> article.html '