Annual Number Source Evaluation Practical Guide: Supplier Review Template and Quality KPI Breakdown

The customer acquisition efficiency of overseas marketing teams largely depends on the quality of their number sources. Whether it’s Telegram group member adding, WhatsApp private message promotion, or iMessage batch outreach, the validity, activity level, and gender tags of phone numbers determine subsequent conversion costs and ROI. Annual number source evaluation is not an optional administrative task but a comprehensive checkup of your data supply chain—identifying issues promptly, eliminating inefficient suppliers, and optimizing detection strategies ensure every penny is well spent.

This article provides a complete supplier review template, covering core KPIs, scoring standards, cross-platform comparison methods, and offers objective references based on common platforms like 007Data, thdata, and KK-DATA. Regardless of which tool you’re currently using, you can directly apply this framework for your annual evaluation.

---

Why Overseas Teams Need an Annual Number Source Evaluation

Many teams stick with a chosen number verification platform long-term, overlooking potential risks:

• Data Drift: The same batch of numbers may show fluctuating registration rates at different times. If the platform’s model updates or its database lags, number quality tags will gradually deviate from reality.
• Functional Gaps: New platforms (e.g., RCS, iMessage) emerge, but old suppliers may be slow to support them, causing missed high-value audiences.
• Price Changes: Hidden fees in subscription-based plans or unit price adjustments in pay-per-check models can lead to overspending without regular review.
• Customer Service Degradation: During peak business periods, technical support response times may drop, directly impacting task scheduling.

Through annual evaluation, teams can quantify each supplier’s quality KPIs, identify which parts need a “blood transfusion” and which deserve continued cooperation. The following core KPI system can be directly used for data-driven decisions.

---

Core KPI Metrics for Number Source Evaluation

Number Validity Detection Rate

Definition: The difference between the “active/valid” number ratio returned by the platform and the actual valid ratio after blind testing (manual message sending or secondary verification).

Measurement Method: Randomly select 100 numbers marked as “valid” from the same batch of detection results, verify manually (e.g., send a message to numbers checked for Telegram registration to see if reachable), calculate the actual active count. Divide actual active by 100 to get the blind-test validity rate, then compare with the platform-reported validity rate. The smaller the difference, the more accurate the detection.

Reference Threshold: Difference ≤ 3% is excellent, 3%~8% is normal, over 10% requires caution.

Activity Matching Rate

Definition: The consistency between the activity window (e.g., 7-day, 15-day, 30-day) marked by the platform and the actual activity behavior of numbers in groups.

Measurement Method: Select multiple groups with known activity levels (e.g., groups with over 50% daily active users), export numbers marked as “7-day active,” observe whether they actually post or come online within 7 days. Calculate matching ratio.

Reference Threshold: Matching rate ≥ 80% is acceptable, ≥ 90% is excellent. Low reliability of activity tags leads to massive ineffective outreach.

Gender Recognition Accuracy

Definition: The degree of agreement between the gender label identified by the platform (based on avatar or nickname) and the actual user’s gender.

Measurement Method: Randomly select 50 numbers marked as “male” or “female,” determine gender through avatar, nickname, and profile information comprehensively (or confirm by sending a message, e.g., TG profile), calculate recognition accuracy. Accuracy ≥ 85% can be used for segmented marketing; below 70% should disable the tag.

---

Annual Supplier Review Template (with Scoring Table)

Evaluation Dimensions and Weight Suggestions

Evaluation Dimension	Weight	Description
Feature Coverage	20%	Support for Telegram screening, WhatsApp, iMessage, RCS, number validity detection, gender recognition, tgid/wsid export, etc.
Detection Accuracy	35%	Actual accuracy based on the KPIs above; the highest weight dimension
Billing Transparency	15%	Whether pay-per-check, allows on-demand top-up and refund, hidden fees
Console Usability	15%	Smoothness of task creation, export, deduplication, notifications; support for batch operations
Customer Service Response Speed	15%	Time from ticket submission to effective reply, and efficiency in handling complaints

Scoring Standardization Guide

Each dimension uses a 1–5 scale, defined as:

• 5 (Excellent): Exceptional performance, far exceeds expectations. E.g., detection accuracy ≥ 95%, customer service responds within 2 hours, supports all major platforms.
• 4 (Good): Meets expectations, occasional minor flaws. Accuracy 90%~94%, customer service responds within 4 hours.
• 3 (Average): Basically meets core needs, but has obvious shortcomings. Accuracy 85%~89%, customer service responds within 12 hours.
• 2 (Poor): Frequent errors or missing features, negatively impacting business. Accuracy < 85%, customer service response exceeds 24 hours.
• 1 (Unacceptable): Almost unusable, or poses fraud risks (e.g., data leakage, fake billing).

Total Score Formula: Total = Σ (Dimension Score × Weight%), full mark 100 (5 × sum of weights = 5, convert to percentage by multiplying by 20, or directly calculate under 5-point system then convert). It’s recommended to unify to a 100-point scale for year-over-year comparison.

Review Cycle and Data Sources

• Quarterly Mini-Review: Spot-check accuracy each quarter, monitor KPI trends.
• Annual Major Review: Combine full-year task data, customer service tickets, price change records, score using the template above.
• Data Sources:
  • Task reports exported from platforms (number lists, detection results)
  • Manual spot-check records (Excel tables)
  • Customer service communication logs (response times, issue resolution rates)
  • Top-up records and bills (reflect billing transparency)

---

How to Compare Actual Performance of Number Screening Platforms (Objective Reference)

Based on the KPIs and review template above, compare platforms like 007Data, thdata, and KK-DATA on the same scale (the comparison below is only based on public information and feature descriptions; actual accuracy should be tested with your own numbers via blind testing).

Comparison Dimension	007Data	thdata	KK-DATA
Feature Coverage	Supports TG/WA/IM, but iMessage/RCS may require separate inquiry	Primarily TG screening, limited support for other platforms	Supports TG/WA/IM/RCS, includes gender recognition, tgid/wsid export, global number generation, data dedup warehouse
Billing Mode	Mainly subscription-based, pay-per-check needs confirmation	Pay-per-check, but unit price not disclosed	Pure pay-per-check, USDT (TRC20) top-up, no subscription plans, estimated cost shown before task
Detection Accuracy	Mixed user feedback, recommend blind testing	Some user base, but activity accuracy varies	Claims high accuracy, actual needs blind testing per KPI
Console Usability	Many features, moderate learning curve	Clean interface but limited functionality	Supports CSV/TXT import/export, data dedup warehouse auto-dedup, task notifications via TG
Customer Service Response	Chinese/English support, moderate response speed	Primarily English, weaker Chinese support	Chinese customer service on Telegram with instant response, comprehensive documentation

Note: The above comparison does not include specific price figures. Unit prices for all platforms are subject to their official websites in real time. Annual number source evaluation is about “letting data speak.” It’s recommended to use the KPI indicators from the review template to track each platform year-over-year.

---

How to Optimize Number Screening Process and Supplier Selection After Annual Evaluation

Based on review results, teams can execute the following improvement actions (in priority order):

1. Eliminate Low-Scoring Suppliers

• Total score below 60 (out of 100), or core KPIs (e.g., accuracy) declining for two consecutive quarters, should trigger immediate alternative supplier evaluation.

2. Add Backup Suppliers

• Don’t put all tasks on one platform. Keep 2–3 backups, regularly rotate for small-sample benchmark tests.

3. Adjust Detection Type Priorities

• If review finds low “activity” tag accuracy, first do only “validity” detection, then use group data for secondary activity filtering to reduce platform costs.

4. Build a “Generate → Screen → Dedup” Pipeline

• Many teams overlook the quality of number generation: randomly generated numbers may be inactive or have overlapping number ranges. It’s recommended to use platforms that support global number generation (e.g., KK-DATA provides 240+ country codes) and combine with a data dedup warehouse to automatically exclude already-checked numbers, avoiding duplicate charges.

5. Annual Checklist

• Have you completed KPI blind tests for all suppliers?
• Have you compared the same batch of numbers across at least 3 platforms?
• Have you updated billing records and checked actual cost differences between pay-per-check and subscriptions?
• Have you optimized detection type combinations (e.g., changing “activity detection” to “validity detection + manual verification”)?
• Have you confirmed the feature roadmap for the next six months with customer service?

---

Frequently Asked Questions

Q: How should KPI indicators be set in the annual number source evaluation?
A: It’s recommended to refer to the core KPI template in this article and assign different weights based on actual business scenarios. For example, teams focusing on activity should set the highest weight for “activity matching rate” (over 40%); brands needing precise segmentation can raise “gender recognition accuracy” to 30%. Each indicator must be quantifiable and retestable.

Q: What is the difference between 007Data and KK-DATA in number screening accuracy?
A: Both support Telegram/WhatsApp and other platform detection, but billing modes differ significantly: 007Data is mainly subscription-based, while KK-DATA uses pay-per-check and supports anonymous USDT top-ups. For specific accuracy, it is recommended to blind test the same batch of numbers and compare detection rates. Don’t rely solely on promotional data; verify through the sampling method in the annual review template.

Q: Are thdata’s screening results really reliable?
A: Reliability must be verified through annual review: randomly sample 100 numbers marked as “valid,” manually send messages to test actual registration rate, and quantify the deviation from the platform’s report. User feedback indicates thdata’s activity tags are sometimes inflated, but validity detection is relatively stable. Base decisions on actual test data, not just claims.

Q: During the annual review, how to judge whether a number screening platform is worth continuing cooperation?
A: If total score is below 60 (out of 100), there are more than two unresolved complaints, or core KPIs decline for two consecutive quarters, start alternative supplier evaluation. Also observe billing transparency: if the platform arbitrarily raises prices or hides fees, even if the score is passing, renegotiate or switch.

---

Conclusion and Next Steps

Annual number source evaluation is not a one-time check but the starting point for continuous optimization. With the KPI template, scoring table, and comparison methods provided in this article, you can systematically discover blind spots in your data supply chain and make informed supplier choices. If you’re currently using pay-per-check or need flexibility for different detection scenarios, consider experiencing KK-DATA’s transparent model—all features are clear in the console, and costs are known before tasks.

Next Steps:

• Visit the App Console to create a screening task and experience the transparent pay-per-check mode.
• Check the Documentation to learn about all supported detection types (Telegram screening, WhatsApp, iMessage, RCS, etc.).
• Add customer service on Telegram @kkdata_cc to get one-on-one supplier evaluation advice, or even obtain a free blind test number list for your annual review.

Has your team done the annual number source evaluation this year? If not, now is the best time.