Dec 1, 2018
We started Agenty in early 2018 and helped many businesses to aggregate the data from thousands of websites, feeds by crawling over a billion pages every month to help them in making data based decisions.
But, over the time we noticed the web is shifting to API model and many of the websites provides the API access, schema structured model embed in web pages to extract the data. So, it became important for us to add something in Agenty which allows users to scrape data from JSON as well along with HTML5 , XML, RSS feeds data scraping.
So, today on December 1st 2018 we are adding JSONPath in Agenty, to allow users to extract JSON attribute easily by defining the the JSONPath query selectors. The JSONPath selectors always refer to a JSON structure in the same way as XPath expression are used in combination with an XML document. Since a JSON structure is usually anonymous and doesn't necessarily have a "root member object" JSONPath assumes the abstract name $ assigned to the outer level object. Here is the detailed article, and also a sample agent available to try out in the demos - https://www.agenty.com/docs/scraping-agent/154/json-scraping





