structured_data

Description:

structured data

Structured Data #
A collection of functions for parsing structured data from web pages. The library supports parsing
microdata, rdfa, and jsonld forms of structured data embedded in a web page.
Warning #
This has not been used in any production application yet, so it may be lacking features or have
some bugs that I haven't encountered yet. Please create issue reports on github to give feedback.
I am actively developing another application that uses this and am fixing issues as I find them, often these updates are potential breaking changes. Use at your own risk, but I would really appreciate any support and feedback!
Usage #
To parse structured data from a web page:
List<StructuredData> data = await StructuredDataImporter.importUrl("path/to/website");
copied to clipboard
To parse structured data from an already loaded web page
List<StructuredData> data = StructuredDataParser.extract(htmlDocument);
copied to clipboard
StructuredData is a dictionary-like object
StructuredData someData;
// Load data by importing from URL
someData["property"]
copied to clipboard
Future Improvements #
Eventually I may overlay some wrapper classes for accessing structured data so it's more than
a glorified map.
References #

Schema.org
Google Structured Data

License

For personal and professional use. You cannot resell or redistribute these repositories in their original state.

Share

• Share on Facebook
• Share on Twitter