Data Sourcing · 3-tier strategy

Institutional-grade data, one identifier end to end.

LSEG Refinitiv and CMOTS at the core for depth and Indian-market breadth. Retail providers as a cost-efficient bridge. Free public sources as the benchmark. Every recommendation traces back to its upstream source via PermID — the open universal entity ID.

Tier 1 Enterprise core

LSEG · Refinitiv Data Platform

  • Reuters News & News Analytics
  • I/B/E/S consensus estimates
  • StarMine quant models
  • ESG factors
  • DataStream historical & macro
  • Lipper Funds · Tradeweb FI

OAuth 2.0, REST + streaming, PermID symbology bridge. Procurement: enterprise quote via UOF (Universal Order Form); free-trial sandbox available before contract.

CMOTS

Indian-market specialist — 226 endpoints across 18 categories.

  • Master & reference (4)
  • Company Fundamentals (28)
  • 5-yr Financials (29)
  • Corporate Announcements (20)
  • Live News (18, 8 am–5 pm)
  • EOD Screeners (27) · Technicals (27)
  • MF (17) + ETF (11) + Fund Portfolio (6) + IPO (7)

REST/JSON; EOD refresh ~11:30 PM IST. Per-endpoint subscription — contact for quote.

NSE / BSE official feeds

Authorised-vendor route to exchange-source real-time tick, Level 2/3 depth and full F&O. Prerequisite for execution-grade signal — TrueData and Global Datafeeds resell from here. NSE's published domestic-vendor tariff (eff. 1 Apr 2025) is ₹24L/yr + ₹820/user/mo for Level 1, ₹37.5L/yr + ₹1,400/user/mo for Level 2, ₹50L/yr + ₹1,975/user/mo for Tick-by-Tick [NSE Tariff Apr 2025].

Tier 2 Retail bridge

TrueData / Global Datafeeds

Authorised NSE/BSE/MCX vendors. REST + WebSocket, 60,000+ symbols, 1s ticks, option greeks, multi-timeframe OHLCV. ₹5–15K/mo [per provider rack rate]. Used through Phase 1 streaming until the LSEG contract closes.

Broker API gateway

Zerodha Kite Connect, Upstox, Angel One SmartAPI, ICICI Breeze. Free with each brokerage account; we abstract per-broker quirks behind a Gateway so user-facing flows stay broker-agnostic. Also the source for user-consented order history.

Screener · Trendlyne · Tickertape

10+ year ratios, con-call transcripts, analyst notes, peer screens. ₹5–20K/mo [per provider rack rate]. Useful as an independent overlap-check against CMOTS fundamentals during data-quality QA.

Tier 3 Public & reference

NSE · BSE · AMFI public

EOD bhavcopy, index constituents & weights, sector classification, AMFI NAV, NSE/BSE corporate-action calendar. Free; high-trust because it is the source-of-record. Used as the baseline benchmark for everything paid above.

CDSL · NSDL eCAS · CAMS · MFCentral

User-consented demat and mutual-fund holdings import. Per-request pricing. Required for personalised advisory; explicit consent & purpose-limitation captured at the point of import.

News RSS · Social · Filings

MoneyControl / LiveMint / ET RSS, NSE & BSE announcements feeds, Twitter/X API, Reddit. Free / API-licensed (per-tier, contact for quote on commercial use). Drives the sentiment overlay on top of LSEG Reuters News.

Coverage

What each source actually covers

Where two sources overlap we keep both — one as primary, the other as an automated cross-check. = first-class coverage, ~ = partial / derived, = not covered.

Capability LSEG / RDP CMOTS TrueData NSE/BSE CDSL/eCAS News/Social
Real-time tick (Eq + F&O)~ via Elektron direct
EOD OHLCV / bhavcopy free
Company fundamentals 28 endpoints~ filings
Consensus estimates (I/B/E/S) primary
Quant factors (StarMine) primary~ ratios
Technical indicators (EOD)~ derive 27 endpoints~ derive
Corporate actions / events 20 endpoints source~ RSS
Index constituents & weights source
Mutual funds (NAV, holdings, ratios) Lipper 32 endpoints~ AMFI NAV
ETFs 11 endpoints~
IPOs (with DRHP / timeline)~ 7 endpoints~ filings
News (EN + HI, real-time) Reuters 18 streams~ announcements
User holdings (demat / MF) source
Symbology (PermID/RIC/ISIN/NSE/co_code) PermID~ co_code~ ISIN
Historical depth

How far back can we look?

Both providers expose history, but at different orders of magnitude. This is the single biggest reason to pay for LSEG on top of CMOTS: backtests, factor research and walk-forward validation need decades, not years.

LSEG · Refinitiv RDP — multi-decade

  • DataStream: deep historical financial & economic time-series, the industry default for long-window macro and fundamental backtests.
  • Tick / intraday history: available for the contracted instrument set — "Time-series content" is a first-class delivery type alongside Real Time, Reference and Bulk.
  • I/B/E/S consensus: historical analyst estimates with point-in-time snapshots — eliminates look-ahead bias in factor research.
  • StarMine quant: long-history factor scores already computed (earnings quality, predicted surprise) so you don't rebuild them.
  • Reuters News archive: deep historical news with rich tagging metadata; Linkback returns canonical URLs for compliant attribution.
  • Research: historical research extractions (text + metadata) available within each contributor's approved time-horizon.

CMOTS — 5-year window, EOD cadence

  • Financials: Quarterly / Half-yearly / Yearly P&L, Balance Sheet, Cash Flow — 5 years standard (TSV category labelled "Company Financial (5 years historical)").
  • Ratios: Margin, Performance, Efficiency, Stability, Valuation, Cashflow, Growth, Liquidity, TTM/Daily/Quarterly/Yearly — all 5 years.
  • Shareholding: 5-yr aggregate & detailed patterns; pledge-shares and insider-trading event history (recent rolling window).
  • Corporate actions: historical book-closure, AGM/EGM, bonus, dividend, splits, mergers, buybacks — full event calendars.
  • Technicals: EOD only — pivots are 5/15-min delayed; no intraday tick archive.
  • Live news: 18 streams during the 8 am–5 pm window only; no published news archive — pair with the LSEG Reuters archive if you need historical sentiment.

Why this matters for advisory

5 years of fundamentals is enough for most retail-facing screeners and recommendation engines. It is not enough for proper factor backtesting, regime-aware risk models, or any use case that needs to survive a full credit cycle (which the Indian market last saw in 2008–10). Plan to source long-window history from LSEG DataStream + I/B/E/S, and use CMOTS as the live, low-latency Indian-market surface on top of it.

CMOTS endpoint map

What 226 endpoints actually buy us

CMOTS is dense — these eight clusters cover the depth we need for fundamental, technical, MF/ETF and corporate-action use cases without ever leaving Indian markets.

Master & reference (4)

CompanyMaster (~6,150 records), Today's Results, Annual / Quarterly result-declaration calendars. Foundation for symbol resolution and event scheduling.

Company Fundamentals (28)

Profile, Board of Directors, Chairman / Director report, Auditor report, Pledge Shares, Insider Trading, Subsidiaries & JVs, Segment-wise revenue (geo + product).

5-year Financials (29)

Quarterly / Half-yearly / Yearly P&L, Balance Sheet, Cash Flow, Share-holding (detailed + aggregate + >1%), all standard ratio families (Margin, Performance, Efficiency, Stability, Valuation, Cashflow, Growth, Liquidity, TTM, Quarterly, Yearly).

Corporate Announcements (20)

BSE + NSE announcements, Book Closure, AGM/EGM, Bonus, Rights, Dividend, Splits, Merger / Demerger, Buyback, OFS, event-date and forthcoming-action lookups.

Live News (18, 8 am–5 pm)

Hot Pursuit, Pre / Mid / End-session commentary, Corporate-results, Stock-alert, F&O update, IPO / Commodity / Mutual-fund / Currency news, Bullion, Forex.

Equity EOD Screeners (27)

Top revenue / yield / valuation / debt screens, 52-week high/low crossings, gap-up / gap-down, FII upward trend, turnaround YoY/QoQ, delivery-percentage ranks.

Technical Indicators (27)

SMA / EMA crossovers, RSI>70 / <30, MACD, ADX, Williams %R, Bollinger band breaks, CCI, stochastic, Pivot (Classic + Fibonacci, BSE/NSE 5–15 min delayed).

MF · ETF · IPO (34)

Scheme master, Daily / Historical NAV, scheme returns & ratios, fund-house portfolios, asset / sector allocation, "What's In & Out", ETF quotes & holdings, IPO master + DRHP + timeline + subscription + risk + strength.

LSEG / RDP capabilities

What the enterprise contract unlocks

Reuters News + Linkback

Real-time and historical Reuters News & News Analytics with rich tagging metadata. Linkback distribution returns canonical URLs to research articles for compliance-friendly attribution inside our advisory output.

I/B/E/S + StarMine

Sell-side consensus estimates and StarMine quant analytics — earnings quality, smart-estimates, predicted surprise. Drives factor scoring without us having to maintain an in-house analyst panel.

ESG · Lipper · DataStream

ESG factor data for portfolio screening, Lipper for global mutual-fund benchmarks, DataStream for deep historical macro and economic series. Tradeweb FI is available if we extend into fixed-income advisory.

Pipeline

PermID-anchored data flow

SourcesLSEG OAuth · CMOTS REST · Broker WS · RSS · CDSL eCAS
IngestionKafka topics by category · 5-min RDP token refresh
ProcessingSpark + Airflow + dbt · normalise to PermID
Feature StoreRedis hot · TimescaleDB · S3 cold · Feast
ML ModelsFactor scoring · sentiment · signal blending · recs
ServingREST · WebSocket · Push
Cost & procurement

What it costs and how we buy it

TierProviderPricing modelOrder of magnitude
EnterpriseLSEG · Refinitiv RDPAnnual licence via UOFEnterprise quote — typically $18K–$90K/yr per seat-and-feed bundle [Vendr benchmark]; Contact for quote
CMOTS12-month annual contract, basket-basedPer-endpoint basket — Contact for quote (contract embeds NSE pass-through tariff above)
Retail bridgeTrueData / Global DatafeedsMonthly rack rate₹5–15K/mo [per provider rack rate]
Broker APIs (Kite, Upstox, Angel, Breeze)Bundled with brokerage accountFree with active account
Screener / Trendlyne / TickertapeMonthly rack rate₹5–20K/mo [per provider rack rate]
Public & referenceNSE · BSE · AMFI publicFreeFree
CDSL · NSDL · CAMS · MFCentralPer-request, user-consentedPer-request — varies by aggregator
News RSS · Twitter/X · RedditFree + API tiersFree + per-tier — Contact for quote on commercial use

Procurement & ops

  • RDP onboarding: free-trial sandbox → UOF (DocuSign) → MachineID + Developer UserID emailed; access tokens via OAuth 2.0 Resource-Owner-Password-Credentials, valid 5 min, refresh-token thereafter.
  • CMOTS: direct sales contract, REST/JSON, EOD jobs land ~11:30 PM IST, intraday news 8 am–5 pm.
  • Throttling: RDP enforces per-API throttling tiers — we pin client concurrency per tier rather than retry-storming.
  • SEBI IA audit trail: every recommendation persists upstream-source IDs (PermID + RIC + co_code + bhavcopy date) so regulator-ready lineage is automatic. Aligns with the SEBI (IA) Regulations 2013, last amended 16 Dec 2024, and the BSE IA Guidelines circular of 10 Jan 2025 — risk-profile records, advice-rationale logs, and 15-day no-trade window timestamps retained for 5 years (market practice).
  • User consent: CDSL/eCAS imports captured with explicit purpose-limitation and an export-on-demand path.

One identifier to rule them all — PermID

PermID is LSEG's open, permanent, never-reused 64-bit identifier that complements RIC / ISIN / LEI / CUSIP / SEDOL. The Open PermID Record-Matching, Entity-Search and Intelligent-Tagging APIs at permid.org are free and require no Workspace contract; the Symbology API is bundled with any RDP content subscription. We adopt PermID as our canonical entity ID and maintain a crosswalk table (PermID ↔ RIC ↔ ISIN ↔ NSE symbol ↔ CMOTS co_code ↔ BSE sc_code) so a single recommendation can be joined to every upstream source without ambiguity. Cost claims above are provider-stated rack rates where public; enterprise figures are intentionally left as "Contact for quote" rather than fabricated.

Sources

References & citations

Pricing & vendor

  • [NSE Tariff Apr 2025] — NSE Real Time Data Tariff for Domestic Vendors, effective 1 Apr 2025 (nsearchives.nseindia.com).
  • [Vendr benchmark] — LSEG / Refinitiv pricing benchmarks (vendr.com/marketplace/refinitiv).
  • [per provider rack rate] — Public rate cards on TrueData, Global Datafeeds, Screener.in, Trendlyne, Tickertape product pages.
  • CMOTS API DataFeed product page (cmots.com/products/api-datafeed) — confirms 12-month annual contract, basket-based pricing.

Regulatory & identifier

  • SEBI (Investment Advisers) Regulations, 2013 — last amended 16 Dec 2024 (sebi.gov.in).
  • BSE Circular — Guidelines for Investment Advisers, 10 Jan 2025 (bseindia.com).
  • LSEG Discovery Symbology API User Guide — PermID crosswalk specification (developers.lseg.com).
  • Open PermID Python APIs (github.com/Refinitiv-API-Samples) — free Record-Matching, Entity-Search, Intelligent-Tagging endpoints.