Web Research, Web Data Extraction and Data Mining Services

Services: 
Web Research, Web Data Extraction and Data Mining

Suntec provides the following web research / web data extraction and data mining services:

• Data Mining: Data extraction and screen scrapping services to excel, access, MS-SQL or MySQL tables, comma delimited file csv
• Web Search, address and email search, mailing list Search to search for contact details of the specific target group
• Tracking, extracting, harvesting records and raw data from a screen or a web site
• Online research and building database in Microsoft Office. Gathering data from websites to an Excel spreadsheet, Access .mdb file, or any structured database format
• Web Mining and Listing. Searching the web and creating lists of target websites and then collecting information from these sites.
• Web search and product research to populate the database for your e-commerce websites / online stores
• Online Form Entry and Submission
• Marketing/sales support services, e.g. market research, survey and analysis, gathering information about competitors’ pricing.
• Web Research and Online Data Entry or Web-to-Web Entry for updating your online stores
• Web Search and Listing, e.g. searching online newspapers for the latest pricing information, or extracting and summarizing news stories from online news sources.

Methodology:
Web Research, Web Data Extraction and Data Mining

We perform a preliminary analysis of your requirements and of the site to understand the data structure. According to the complexity we will work on the method of obtaining the raw data from records, in rows and columns format and return them to excel, Access or tables of SQLServer tables, comma delimited or text files. We'll use custom program to perform a screen scrapping, or will manually extract the data.

A member from our professional team experienced in such online data extraction projects will communicate with you to understand your specific requirements, and will continue to liaise with you for instructions, status updates and ensuring timely deliverables.

We'll be more than willing to acquire new knowledge about your business and your requirements and we'll work with on a sample/prototype project to let you evaluate our capabilities.

Typical Cases
Web Research, Web Data Extraction and Data Mining

Copy the product information from an e-commerce site into database

The client is starting an online stores / e-commerce site to sell all products available on his supplier's site. He needs all the product information from the supplier's website. The major challenge is that there are more than 100,000 products on the targeted website and all products should be saved in the exactly same format into a database (Access or any relational database) with all possible product information (i.e. name, description, product details, SKUs, categories, shipping, price, etc.).

Further, the products on this site are separated into hundreds of categories and thousands of subcategories. Some products directly belong to the main categories but many others are under subcategories' subcategories. We need to understand and separate the specific category information for each product and save the corresponding information into the product database.