What is web scraping?
Web scraping aka. web extraction or web crawling refers to the process of obtaining various unstructured information from any websites and turn it into structured, clean data such as xls, csv, or txt or populate the captured data to a database directly. Some common uses of web scraping include lead generation, data collection for academic researches, price monitoring from…Continue
Added by Nora Choi on September 1, 2017 at 18:40 — No Comments
There are thousands of big data tools out there for data analysis today. Data analysis is the process of inspecting, cleaning, transforming, and modeling data with the goal of discovering useful information, suggesting conclusions, and supporting decision making. To save your time, in this post, I will list out 30 top big data tools for data analysis in the areas ofopen source data…Continue
Added by Nora Choi on August 28, 2017 at 13:42 — No Comments
There are over 2.8 billion social media users till 2017, reported by an analysis report from We Are Social and GWI. With a number like this, we can see an ever fast growing user group in the digital marketing.
Now, thanks to the social media marketing tools, enterprises are able to target these prospective customers much faster from so many social media users, and thus reducing the cost. Here, I will put a list of 8 top marketing tools to help you with your digital…Continue
Added by Nora Choi on July 11, 2017 at 13:09 — No Comments
Web scraping, also known as web crawling, (web) data extraction, data mining, screen scraping, is the process of collecting large amounts of data from the web, then save to a file, database, etc. Let’s dig deeper into web scraping.
It’s estimated that the…Continue
Added by Nora Choi on May 15, 2017 at 19:13 — No Comments
Users may exhibit different behaviors and show their preference towards videos of various types on a social media platform. For a media platform, these data coming from users proves very important to make a more comprehensive assessment. Thus, it’s important for a media platform to dig into what are sought after by its users and how to get more insights from these users to offer more pleasant service and generate more sales leads.…Continue
Added by Nora Choi on May 9, 2017 at 19:06 — No Comments
Web crawling (also known as web scraping) is widely applied in many areas today. It targets at fetching new or updated data from any websites and store the data for an easy access. Web crawler tools are getting well known to the common, since the web crawler has simplified and automated the entire crawling process to make web data resource become easily accessible to everyone. Using a web crawler tool will set free people from repetitive typing or copy-pasting, and we could expect a…Continue
Added by Nora Choi on April 26, 2017 at 20:30 — No Comments
Job sites are really popular today for anyone to find the right job or for any firm to hire the perfect candidates. These sites, however, also house large quantities of aggregated data which provides good insights for job trends, salary levels, competitors‘ info and many others. While these job sites are overwhelmed with massive volume of data, recruiters should know how to leverage and make full use of them while they are still fresh on the web.…Continue
Added by Nora Choi on April 19, 2017 at 21:31 — No Comments
To start with Sentiment Analysis, what comes first to our mind is where and how we can crawl oceans of data for our analysis. Normally, web crawler or crawling from web social media should be one reasonable way to get access to the public opinion data resource. Thus, in this writing, I want to share with you about how I crawled the website using web crawler and proceeded to deal with those data for…Continue
Added by Nora Choi on March 1, 2017 at 16:23 — No Comments
(picture from gifaom.com)
I want to share with you in this post some best free web scrapers for non-programmers who want to gain insight from large data-set online at low…Continue
Added by Nora Choi on January 19, 2017 at 22:55 — No Comments
(picture from databigandsmall.com)
We know most companies today collect big data to analyze and interpretate of daily transaction and traffic data for keeping track of the operations, forecasting needs or implementing new programs. It is in this way that we define big data as the capability allowing companies to extract value from large volumes of different kinds of data. But how to collect such capability of big data we want directly?
There may be…Continue
Added by Nora Choi on December 22, 2016 at 19:40 — No Comments