Introduction

minestrone is an opinionated Python library that lets you search, modify, and parse messy HTML with ease.

Behind the scenes

minestrone utilizes Beautiful Soup to do all the real work, but aims to provide a simple, consistent, and intuitive API to interact with an HTML document. Beautiful Soup provides a lot of functionality, although it can be hard to grok the documentation. The hope is that minestrone makes that functionality easier.

Related projects

There are a few other libraries to interact with HTML in Python, but most are focused on the retrieval of HTML and searching through the document. However, they are listed below in case they might be useful.

Beautiful Soup related

• SoupSieve: provides selecting, matching, and filtering using modern CSS selectors. It provides the functionality used by the select function in Beautiful Soup which is also used by minestrone, however it can be used separately.

• soupy: wrapper around Beautiful Soup that makes it easier to search through HTML and XML documents.

• fast-soup: faster Beautiful Soup search via lxml.

• BeautifulSauce: Beautiful Soup’s saucy sibling!

• SoupCan: simplifies the process of designing a Python tool for extracting and displaying webpage content.

Beautiful Soup replacements

• lxml.html: based on lxml, but provides a special Element API for HTML elements, as well as a number of utilities for common HTML processing tasks.

• html.parser: simple HTML and XHTML parser in standard library.

• parsel: Parsel is a BSD-licensed Python library to extract data from HTML, JSON, and XML documents.

• gazpacho: simple, fast, and modern web scraping library. The library is stable, actively maintained, and installed with zero dependencies.

• Requests-HTML: HTML Parsing for Humans. It intends to make parsing HTML (e.g. scraping the web) as simple and intuitive as possible.

• regex: just kidding, you probably shouldn’t use regex to parse HTML unless you are a masochist.