Scraped data text analysis projects allow you to bring reviews and other supported online content directly into Journey Insights Hub.
Start a new text analysis project
From the Projects page, select + New project.
Only users with the appropriate permissions can create a new text analysis project.
There are two ways to add URLs for scraping.
Add URLs manually
On the text analysis project creation page, find the source you want to collect data from and select the + icon next to it
Enter or paste the URL for the page you want to scrape
Repeat this process to add additional URLs as needed
You can add multiple URLs and combine different supported sources within the same text analysis project.
For example, you could compare reviews from two retailers to explore questions such as: What topics or experiences are unique to shoppers on each site?
Tip: Make sure your URL matches the suggested format in the field. Check for the product name and SKU or comment thread name as appropriate.
Upload a list of URLs
If you have already gathered a larger list of URLs, select Choose file to upload them instead of entering each URL manually.
You can upload a .TXT or Excel file containing the URLs you want to scrape. This can be especially useful when you are working with many links or preparing the list outside of Journey Insights Hub.
Download your URL list
After adding URLs, you can select Download links to scraper file to download a .TXT file containing the links currently included in the text analysis project. This gives you a copy of the URL list that you can save, reuse or update later.
Choose update and notification settings
Before creating the text analysis project, choose whether you want to receive an email when it is ready.
You can also choose whether the text analysis project should collect new data on a recurring schedule. Scraped data can be updated:
Daily
Weekly
Scheduling updates can help you continue tracking new reviews or comments after the text analysis project is created.
Create the text analysis project
Review the selected sources, URLs, and update settings, then create the text analysis project.
Journey Insights Hub will begin collecting the available content and analyzing it. The amount of time required may vary depending on the source and the volume of data.
Need another data source?
For access to additional sources, contact [email protected].
The Cemantica team may be able to connect you with partners who can source content such as product reviews, Instagram posts and other online data.