Make Money Online AUTOMATION Let's Automate Instagram without using the API – Web Automation Screen Scraping with PHP and cURL

Let's Automate Instagram without using the API – Web Automation Screen Scraping with PHP and cURL

Let's Automate Instagram without using the API – Web Automation Screen Scraping with PHP and cURL post thumbnail image



In this video I tactically automate Instagram to extract Recent Posts. Instead of using the API I use screen scraping to get started fast and treat the Application as an API.

► An introduction to PHP
► An overview of REGEX in PHP
► Screen Scraping Web Site using PHP
► Processing JSON in PHP
► Add assertions to live code to guard against application changes

– previously talked about APP as API
– here is a good example
– Instagram have an API which requires a dev key etc.
– But instagram also have a GUI which does not require logging in or API key
– Instagram GUI is primarily JavaScript based i.e. when we issue a request we don’t get an HTML page we get a page dyanmically created from an embedded JSON payload
– To automate then:
– call the page
– treat most of the page as a header
– treat most of the page as a footer
– pull out the embedded JSON and parse
– There are risks to this:
– it isn’t an official API
– they might change the JSON
– they might change the page format
– there are many ways this might break
– so code against those ways and assert on your expectations
– walk through the PHP code that does this

See also my video on Ruthless Efficiency where I start to automate Instagram –

*************

► Subscribe to My Channel For more videos like this

*************

►► Contact Details:

Read my writing and blogs at:




Follow me on social media:


★ – @eviltester

*************

►► Read my books

★ “Dear Evil Tester” – explore the tester’s mind
★ “Java For Testers” – learn to code in Java
★ “Automating and Testing a REST API – a case study”

*************

►►Learn skills from my online training courses

★ Selenium WebDriver With Java
★ Technical Web Testing 101
★ Evil Tester Talks Technical Testing
★ Case Study: Java Desktop Application Technical Training

*************

Related Post