Golang · Scrapers

Scrapers

• PuerkitoBio/goquery on GitHub, opens in a new tab

  15Kstars

  GoQuery brings a syntax and a set of features similar to jQuery to the Go language.

  Go·BSD 3-Clause "New" or "Revised" License·active·3 hours ago

• mvdan/xurls on GitHub, opens in a new tab

  1.3Kstars

  Extract urls from text.

  Go·BSD 3-Clause "New" or "Revised" License·steady·5 months ago

• slotix/dataflowkit on GitHub, opens in a new tab

  716stars

  Web scraping Framework to turn websites into structured data.

  Go·BSD 3-Clause "New" or "Revised" License·dormant·3 years ago

• foolin/pagser on GitHub, opens in a new tab

  112stars

  Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler.

  Go·MIT License·slowing·3 years ago

• zoomio/tagify on GitHub, opens in a new tab

  39stars

  Produces a set of tags from given source.

  HTML·Apache License 2.0·slowing·2 years ago

• kkyr/go-recipe on GitHub, opens in a new tab

  32stars

  A package for scraping recipes from websites.

  Go·Apache License 2.0·dormant·3 years ago

• cyucelen/walker on GitHub, opens in a new tab

  14stars

  Seamlessly fetch paginated data from any source. Simple and high performance API scraping included.

  Go·MIT License·dormant·3 years ago

• aafeher/go-sitemap-parser on GitHub, opens in a new tab

  8stars

  Go language library for parsing Sitemaps.

  Go·MIT License·active·yesterday