Our client offers a popular subscription-based competitive intelligence platform in the USA and Canada. This platform/tool automates tedious manual data collection and produces timely market insights that can be used to understand competitors' strategies, campaigns, products, pricing, etc. This empowers brands to act quickly and maintain their competitive edge in the market.
The client has a network of incentivized partners to constantly collect industry-wide data from diverse sources and submit it to the client's portal. They approached us in 2006 for data standardization services. We had to de-duplicate, standardize, and process this data, enabling the client to make competitive intelligence reports for their customers.
Impressed with the quality of services provided, the client delegated more responsibilities to us. Our team now handles end-to-end data support to the client including data collection, data management, data processing, and annotation. We have currently taken over 85% of the client's process with a dedicated team of 200 resources.
The project threw several challenges on our team that were to be dealt with proactively, including
Addressing the above challenges required a proactive and collaborative approach, involving multidisciplinary teams and industry experience.
Depending on the client's requirements, our team processes 6K to 8K PDF data sector-wise on a daily basis, including scanned copies of documents and electronic data. Matching the brand's (client's customers) needs, our team performs data collection and sorting to filter out relevant data from large datasets coming from different partners.
We receive unstructured data in the client's portal. Hence, to make it usable and present it to the end users, our data management experts perform the following actions-
Our data processing experts convert the cleansed data into a ready-to-use format, as needed by various clients' customers. This step involves aggregating and transforming data to generate reports and gain actionable insights.
We have to meet their daily targets by entering data from different PDFs into the client's platform. Our data entry experts capture data from electronic mail, direct mail, print media, mobile digital, social media, and website URLs in real-time and enter it into pre-defined competitor intelligence forms.
Our data research team keeps a tab on the competitor data points required by the end users. Based on what data is needed, our team extracts relevant data and creates actionable & insightful competition reports that are ready to be sent to the client.
Moreover, when needed, our data analytics experts provide all the reports and detailed notes to the client to help users extract valuable insights, identify patterns and measure their performance against competitors.
The client's old website was outdated. Therefore, we assisted the client in website and data migration to the AWS platform. To help the client stay up-to-date and free from bugs and technical glitched we support the client in giving recommendations on changes in the portal, admin dashboard, website, functionalities, etc.
To increase efficiency, we are integrating AI to automate certain tasks like automatically extracting details from PDFs during data entry. We are also providing annotation support to enable advanced competitor monitoring.
While the client is working on automating a few aspects, given the nature of work, data volume, and unstructured data from diverse industries, the client focuses Human-in-the-loop approach and says that the process cannot be fully automated, making the need for data experts irreplaceable.
Considering data volume and multi-format data from different sectors and industries, errors in processing and entering data were inevitable. However, by implementing a strict quality assurance process in place, we were able to successfully go from 70% to 99% data accuracy.
We used SunTec recently and were very impressed with their work. The results were very accurate data in a short timeframe. The staff were professional and thorough. We will not hesitate to use SunTec again for future work, and would recommend them to other companies with similar requirements.Adrian Dick