Elephant Index
목록으로
AI Nativeness4분EN

Which Number Should We Trust?

Working with AI · Part 3

연재 「AI와 일하는 회사」 6번째 글

한국어로 읽기

Sales asks AI for last month’s revenue and sees KRW 1.2 billion. Finance sees KRW 1 billion. Sales counted contracts signed and finance counted delivered transactions recognized as revenue. Both teams have evidence. The meeting stalls if nobody knows which definition fits the decision.

Start with the decision the number supports

Show bookings and recognized revenue side by side when reviewing a quarterly target. Production planning also needs promised delivery dates and the likelihood of cancellation. Record the metric’s purpose, calculation, date cutoff, and exclusions. An AI answer should identify the definition and let the reader open the source transactions. If dates or definitions are missing, ask for clarification.

Assign the correction to its source

A discrepancy may come from a transaction record, an aggregation rule, or the tool’s choice of metric. Operations can correct transaction status, the metric owner can update the definition, and the tool team can fix the mapping. Keep a recurring error as a test case. Ask two people to answer the same management question independently and compare the definitions and records they used.

Why Wikimedia publishes two measures

Wikimedia defines page views and unique devices separately. One device can generate multiple views, and the device count only approximates audience size. Bookings and shipments need equally clear definitions. Test a June contract shipped in July against both measures, then decide which period will change when a return arrives later.

Wikimedia’s page-view definition · Wikimedia’s unique-device definition

When one transaction enters two metrics

Use bookings to assess incoming demand and shipments to understand fulfillment. Both measures come from the same ledger and can present a different monthly picture.

Workflow and decision points
  1. Identify the decision
  2. Specify the event and date cutoff
  3. Reconcile with the ledger
  4. Assign the correction owner
Monthly bookings and shipments (KRW million)
June bookings
120
June shipments
50
July bookings
30
July shipments
100

Illustrative transactions in KRW millions. One deal worth 70 was booked in June and shipped in July, one worth 50 was booked and shipped in June, and one worth 30 was booked and shipped in July.

If 20 of the July shipment is returned in August, define whether to restate July or report the adjustment in August. Include the definition and date range with the AI answer.

Series index

목록으로