task description

Step 1: Data retrieval from BidStream
I will grant us viewer access in BidStream, which will allow us to extract all bidding data passing through a specific geographical area. The data will be saved for two days so we need to develop a mechanism that will collect it.

Step 2: Supplementary dataset
I will provide a complete list of phone numbers from the same geographical area, including associated addresses.

Step 3: User behavior analysis
We will collect bids associated with unique users based on defined digital behavior patterns. For example, if a user views the same ad multiple times within a particular location, that site may correspond to their home or office. Time-of-day patterns will help determine whether the location is more likely a residence or workplace.

Step 4: Rainbow table generation
We will create a rainbow table linking each unique advertising identifier (AdID) to its inferred home address and phone operator.

Step 5: User dataset alignment
We will repeat Step 4 until we have a balanced dataset containing an equal number of unique users (from BidStream data) and phone numbers (from the provided list).

Step 6: Data matching and correlation
We will match AdIDs to phone numbers using a probability-based mechanism. The cross-referencing will primarily rely on shared data points such as address and phone provider. Adding demographic details like gender or age, where available, will further improve the matching accuracy.

db sample

Phone numberSourceFirst nameLast nameAgeSexUsernameUser IDStatusTikTok IDMemberDayTimeHair colorSkin colorProfile picture URL
420777282705WhatsApp41malemaximburkovskiactivated6.58368044332489E+018brownwhitehttps://pps.whatsapp.net/v/t61.24694-24/263253410_381951547200879_4868022058979099893_n.jpg
491601000016TelegramKiraSteffen46femalekirasteffencoaching6739883084No411/7/2025 16:30https://b.us9eon5yw.online/6739883084-5366496933125938652.png

data.log sample

Part of it converted to table, for better readability

idtagidbidfloorbidfloorcurapp_bundleapp_nameapp_publisher_iddevice_uageo_latgeo_longeo_countrygeo_regionipmakemodelososvifaexchangetscid
1zmaticoo_25253600.027499USD1451873163Feed Preview for Insta・Plannerzmaticoo_5135535Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-25.5026-49.2908braparaná179.68.100.247appleiPhoneios17ac070961-5fca-41ef-9371-b5f240d5ddf1Fyber2025-05-07T16:40:20.306-04:00444054
113682180.235243USDcom.xm.cseeiCSee20744Mozilla/5.0 (Linux; Android 10; moto e(7) Build/QOGS30.569-83-18; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/127.0.6533.103 Mobile Safari/537.36-5.126171-39.727676braceará191.7.202.144motorolaGeneric Androidandroid10ccd81441-45e9-4a5f-963b-07a55ab9eb91bigo.sg2025-05-07T16:40:20.320-04:00444054
1zmaticoo_com.magicv.AirBrush-banner0.107856USD998411110AirBrush: Face Photo Editorzmaticoo_12332Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-22.4083-51.5248brasão paulo167.250.175.169appleiPhoneios1744761cab-c8b1-4b93-bcec-247dd4e20252applovin2025-05-07T16:40:20.324-04:00444054
1zmaticoo_29739960.057352USD605569663Amerigo File Managerzmaticoo_5135535Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-23.5475-46.6361brasão paulo177.38.41.124appleiPhoneios149211e7d7-4d1c-4787-ab55-5557a65bc13cFyber2025-05-07T16:40:20.369-04:00444054
1zmaticoo_23173320.023326USD922516896Dominoes Jogatina: Board Gameszmaticoo_5135535Mozilla/5.0 (iPhone; CPU iPhone OS 18_3_2 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-5.3051-42.8502brapiauí189.97.242.136appleiPhoneios12bde16f1b-bae4-45ea-8b6d-8df0e05c58f3Fyber2025-05-07T16:40:20.406-04:00444054
113682180.235243USDcom.xm.cseeiCSee20744Mozilla/5.0 (Linux; Android 14; SM-A065M Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/134.0.6998.40 Mobile Safari/537.36-15.317666-49.579267bragoiás186.195.101.22samsungE1003android144eb7597e-62f5-4824-86f5-3622d3462686bigo.sg2025-05-07T16:40:20.428-04:00444054
127181680.116249USD587366035Picsart AI Video Photo Editor25064Mozilla/5.0 (iPhone; CPU iPhone OS 16_0_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-23.5583-46.9735brasão paulo143.0.189.0appleiPhoneios16.0.35D2AF632-BD03-4999-96E3-5B5E798942C5applovin2025-05-07T16:40:20.506-04:00444054
113682180.872195USD1176147574Sofascore - Live sports scores20744Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-22.81-43.36brario de janeiro179.250.166.0appleiPhoneios18.4.1D48E62D5-4B42-4D7B-9218-FE392CD02415GoogleMobileAds-iOS2025-05-07T16:40:20.598-04:00444054
1zmaticoo_WATTPAD_IOS_MATURE_BANNER_BIDDING-39757950.02675USD306310789Wattpad_iOS_Interstitialzmaticoo_5135224Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-3.1032-60.0288braamazonas187.112.25.185appleiPhoneios154f65c528-1af2-49ae-9587-25ed4c8c3ee6Vungle2025-05-07T16:40:20.631-04:00444054
113682180.297439USD1176147574Sofascore - Live sports scores20744Mozilla/5.0 (iPhone; CPU iPhone OS 18_3_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-22.91-43.17brario de janeiro2804:388:a042::appleiPhoneios18.3.1E4393ACD-0B11-4FF6-95D2-23C79CBC0491GoogleMobileAds-iOS2025-05-07T16:40:20.631-04:00444054
1zmaticoo_com.camerasideas.InstaShot-banner0.202444USD997362197InShot - Video Editorzmaticoo_5135195Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-21.6774-41.4553brario de janeiro177.131.164.122appleiPhoneios17a9638066-8eee-4943-b1f1-509622fa1e72unity sdk2025-05-07T16:40:20.642-04:00444054
110550667.49USDcom.tranzmateMoovit: Your Transit Tracker217016Mozilla/5.0 (Linux; Android 14; 2312DRA50G Build/UKQ1.231003.002; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-23.6301-46.6378brasão paulo177.26.234.1xiaomi6045Yandroid147fb1ac40-2d59-488c-bec7-9e71925844daFyber2025-05-07T16:43:19.531-04:00
1BANNER_BID-23147990.0515USDcom.gamebrain.hexasortHexa Sort5f064bf93191d60018f0fd5aMozilla/5.0 (Linux; Android 15; moto g54 5G Build/V1TDS35H.83-20-5-2; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-21.5974-48.4534brasão paulo189.50.230.109motorolaSKR-A0android15c137a263-7607-40a3-85ca-f8503a5b89c7VungleDroid2025-05-07T16:43:19.535-04:00
15e42fd7956eefea709de3ac3d07b8e970.0001USD1559032748State.ioe607ef46a2b1803becaccc152bee01e4Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-23.6328-47.0203brasão paulo160.20.85.28appleiPhoneios13ACA948A0-8B5F-4CB1-9301-D9E9E7185EBFadx2025-05-07T16:43:19.538-04:00
112972653-10.0011115997USDcom.art.pixel.beauty.girl.games.paint.color.by.numbersNostalgia Color106979460Dalvik/2.1.0 (Linux; U; Android 14; RMX3834 Build/UP1A.231005.007)-16.69-49.26bragoiás179.251.146.178realmeGeneric Androidandroid1479c1ff99-ed14-40c5-9874-e5a3ebbd7439Yandex Mobile Ads SDK2025-05-07T16:43:19.538-04:00
1IT_PM_FUTBIN_ANDROID_TABLET_BANNER_M_BS_320X53_STICKY_M020-03402090.15USDcom.futbinIT-PM_Futbin_Android5a53889945eaab512501251eMozilla/5.0 (Linux; Android 10; moto e(7) plus Build/QPZS30.30-Q3-38-69-12; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Safari/537.36-24.0777-49.3261brasão paulo45.233.107.102motorolaBTV-DL09android100753c20f-0385-485f-939c-afe68152d926VungleDroid2025-05-07T16:43:19.538-04:00
16edb5db42f6c5c63d15eba9ef41928ed0.096885813USD993090598Ludo King8a2e747ab9fc95ccfea1c74c3d58a292Mozilla/5.0 (iPhone; CPU iPhone OS 18_1_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-14.4109-44.4421braminas gerais200.75.177.19appleiPhoneios151CFE76F9-0080-4F7F-AD4D-8CA6331B81EDadx2025-05-07T16:43:19.541-04:00
113682180.153658USD1176147574Sofascore - Live sports scores20744Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-23.96-46.33brasão paulo2804:7f0:b201::appleiPhoneios18.4.104F6FAA0-C5E7-4CD4-96EA-7E1398F64737GoogleMobileAds-iOS2025-05-07T16:43:19.543-04:00
13.181843USDcom.easystudio.screw.pin.jam.puzzleScrew Pin Jam Puzzle769Mozilla/5.0 (Linux; Android 12; SM-M515F Build/SP1A.210812.016; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-8.0091-34.9498brapernambuco179.235.194.91samsungANE-LX2Jandroid12ceafee15-b4be-4bae-abb1-b5fe3336929aBidMachine2025-05-07T16:43:19.545-04:00
116048260.03USDcom.playgendary.tomBlis Media XAPI16928Mozilla/5.0 (Linux; Android 14; SM-A155M Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-23.5257-46.8288brasão paulo170.246.213.14samsungANE-LX2Jandroid14E722E3E9-ADA1-4932-9E09-DBABFABEB1F3fyber2025-05-07T16:43:19.545-04:00
10.013333USD605569663Amerigo File Manager7875666235094034b71bb55a14b2bdecMozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-3.6867-40.3481braceará168.181.84.98appleiPhoneios13FE275847-A19B-4B94-B5DF-7BFC51A258E6inmobi2025-05-07T16:43:19.545-04:00
1ADS_NEW_SPLASH_WF_2_5_20250221-77770133.6894USDcom.dywx.larkplayerLark Player575d1c861295e1447c0000e5Mozilla/5.0 (Linux; Android 14; moto g24 Build/UTAS34.82-106-3; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-12.8665-38.4858brabahia189.40.93.226motorolaANE-LX2Jandroid149cacad22-cb87-4058-9a9c-16ecc511e750VungleDroid2025-05-07T16:43:19.546-04:00
1BN_BIDDING-38486380.0345USDcom.ig.screwdomScrewdom_com.ig.screwdom5ce32f41e15f77001148e36dMozilla/5.0 (Linux; Android 14; SM-S911B Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/136.0.7103.60 Mobile Safari/537.36-23.71-46.294brasão paulo179.93.200.240samsungSM-A320FLandroid141b24f054-ac46-41a5-92ee-02938fc574c3VungleDroid2025-05-07T16:43:19.547-04:00
14186172-400.0011115997USDpuzzle.blockpuzzle.cube.relaxQBlock106737652Dalvik/2.1.0 (Linux; U; Android 14; SM-F731B Build/UP1A.231005.007)-22.91-47.06brasão paulo191.59.116.84samsungGeneric Androidandroid1414eab8b1-8e0f-44df-a817-a66929f2f06fYandex Mobile Ads SDK2025-05-07T16:43:19.550-04:00
10.0USDcom.goods.master3d.triple.puzzleGoods Master 3D396-1Mozilla/5.0 (Linux; Android 14; SM-M546B Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.113 Mobile Safari/537.36-23.6301-46.6378brasão paulo187.43.159.208samsungANE-LX2Jandroid1414229ce3-561b-4e8a-8499-04df634609f9BidMachine2025-05-07T16:43:19.553-04:00
1WOW_ANDROID_BANNER_BIDDING-04660420.03USDcom.fugo.wowWords Of Wonders - Android5bb6123fa4ae3604537ad781Mozilla/5.0 (Linux; Android 14; SM-A346M Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-22.8896-43.1054brario de janeiro177.12.16.18samsungANE-LX2Jandroid14cc98866f-1541-4004-a3c7-1250dd644438VungleDroid2025-05-07T16:43:19.554-04:00
12375690-240.0111159967USDcom.rimashev.nextbotNextbots In Backrooms: Shooter96934425Dalvik/2.1.0 (Linux; U; Android 11; Redmi Note 8 Pro Build/RP1A.200720.011)-8.63-53.37brabahia179.108.134.206xiaomiGeneric Androidandroid11dabb8cd2-b527-45e9-8551-fc12ec205edcYandex Mobile Ads SDK2025-05-07T16:43:19.554-04:00
127359551.66USDai.socialapps.speakmasterPolyBuzz: Chat with AI Friends228005Mozilla/5.0 (Linux; Android 10; LM-X525 Build/QKQ1.200531.002; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-23.6301-46.6378brasão paulo179.228.203.226lgGeneric Androidandroid101107ded2-b050-4494-94ec-0d84cb3ef6daFyber2025-05-07T16:43:19.554-04:00
1N_CB_AOS_Static_INT_M_Tier100.99USDwp.wattpadWattpad - Read & Write Stories5715900504b01630fe7bb4fbMozilla/5.0 (Linux; Android 12; moto e22 Build/SOWS32.121-56-43; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.113 Mobile Safari/537.36-12.2337-39.0656brabahia45.165.89.15motorolaXT1943-1android12beb016ae-b99d-4bbc-bf49-bb25995d5568Chartboost-Android-SDK2025-05-07T16:43:19.557-04:00
1BANNER_MAX-52201210.03USDcom.paperdoll.diary.dressup.gamePaper Doll Diary: Dress Up DIY5d53cf81ff5bd700186c5f35Mozilla/5.0 (Linux; Android 14; SM-A155M Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-8.0567-34.8815brapernambuco45.186.54.22samsungANE-LX2Jandroid14b146c9b8-b2aa-4dba-bb31-10e5773ab7a9VungleDroid2025-05-07T16:43:19.561-04:00
111.0245USDcom.etg.qr.scannerQR Scanner ETG747Mozilla/5.0 (Linux; Android 13; SM-A135M Build/TP1A.220624.014; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/136.0.7103.60 Mobile Safari/537.36-13.7178-41.0838brabahia138.255.33.144samsungF103 Proandroid134fade420-1b77-4867-8e16-7c6eec1a0320BidMachine2025-05-07T16:43:19.564-04:00
1ADS_NEW_SPLASH_WF_7_20250123-130188510.3305USDcom.dywx.larkplayerLark Player575d1c861295e1447c0000e5Mozilla/5.0 (Linux; Android 13; 2209116AG Build/TKQ1.221114.001; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-32.0766-52.3542brario grande do sul170.150.105.197xiaomiSKW-A0android13e1664cab-c83b-4d71-b20d-16273963a883VungleDroid2025-05-07T16:43:19.567-04:00
136260080.07228USDcom.vitastudio.mahjongVita Mahjong27048Mozilla/5.0 (Linux; Android 14; SM-A055M Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-1.344-48.3851brapará189.105.59.125samsungANE-LX2Jandroid14140f9a33-3f76-4abd-8a33-8f2574e0352aBidMachine2025-05-07T16:43:19.568-04:00
1SEARCH_VIDEO_RESULT0_NEW_FS-63943710.15USDcom.snaptube.premiumSnaptube575d1c861295e1447c0000e5Mozilla/5.0 (Linux; Android 13; SM-A528B Build/TP1A.220624.014; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-23.5257-46.8288brasão paulo170.81.210.254samsungANE-LX2Jandroid13a4e1895d-51b8-4cbb-97c1-fd74d89c6bf0VungleDroid2025-05-07T16:43:19.568-04:00
1738973_PLACEMENT_VIDEO_0_0_PB_MAX-11008132.66USDcom.sockslitepro.netcom.sockslitepro.net/738973561e8d956b8d90f61a003219Mozilla/5.0 (Linux; Android 11; moto e20 Build/RONS31.267-94-14; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-22.9072-43.1883brario de janeiro191.57.20.80motorolaXT1943-1android111e3d0368-a165-471c-9d94-08884b72f663VungleDroid2025-05-07T16:44:05.610-04:00
12052020.01274USDcom.vincentb.MobControlMob Control12266Mozilla/5.0 (Linux; Android 13; SM-A135M Build/TP1A.220624.014; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-12.8653-39.0962brabahia200.80.108.180samsungANE-LX2Jandroid132e7428ee-40c5-44c2-b919-12af98c4c3bdinmobi2025-05-07T16:44:05.611-04:00
1ce1cdb4c547b9fea89a99f0ed593692c0.01USDcom.mintgames.wordtripWord Scenery: Crossword2f6a6fab6fcfd504a290e2649c6d6c28Mozilla/5.0 (Linux; Android 14; 2409BRN2CL Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/132.0.6834.163 Mobile Safari/537.36-22.1783-47.3427brasão paulo177.71.11.104xiaomi6045Yandroid1407e9b1c1-85db-485d-a3e3-8058712cec08adx2025-05-07T16:44:05.611-04:00
1ADS_NEW_SPLASH_BIDDING-28976291.07USDcom.dywx.larkplayerLark Player575d1c861295e1447c0000e5Mozilla/5.0 (Linux; Android 14; SM-A155M Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/126.0.6478.110 Mobile Safari/537.36-22.9201-43.0811brario de janeiro179.66.175.42samsungANE-LX2Jandroid1417db3adb-e563-43de-8dd9-95382312e984VungleDroid2025-05-07T16:44:05.612-04:00
1fbad1cfa5b3efd6de9a2870ccf92ca172.492733564USDcom.staytodo.demolistPlanDone Listef01b57da706630bb866071d3d859da4Mozilla/5.0 (Linux; Android 10; moto e(7) plus Build/QPZS30.30-Q3-38-69-12; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-21.6675-49.6972brasão paulo189.126.185.28motorolaBTV-DL09android10684026cc-6b8f-4726-94aa-f89bfb1e04a9adx2025-05-07T16:44:05.612-04:00
114421160.12USD498477945Moovit: Bus & Transit Tracker217016Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-30.0273-51.2353brario grande do sul191.39.5.139appleiPhoneios13B8C01B33-D416-4931-A135-38F86D216BD7Fyber2025-05-07T16:44:05.613-04:00
1ANDROID_INLINE_BIDDING-21665590.2USDde.motain.iligaOneFootball Android65241b8db3ff7d001153bca8Mozilla/5.0 (Linux; Android 15; motorola edge 50 pro Build/V1UMS35H.10-67-3-1; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-3.1032-60.0288braamazonas191.189.26.247motorolaMoto G Plus (5th Gen.)android153ea32bed-372f-469f-9b00-d1af87b287e6VungleDroid2025-05-07T16:44:05.614-04:00
127181680.12125USD587366035Picsart AI Video Photo Editor25064Mozilla/5.0 (iPhone; CPU iPhone OS 16_7_11 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-1.345-48.4219brapará189.40.105.0appleiPhoneios16.7.11A1FDE6D2-6567-421A-BD7C-474D0DF98F06applovin2025-05-07T16:44:05.615-04:00
1banner00210.2625USDcom.bible.happy.art.jigsaw.puzzle.free.gameBible Jigsaw - Jigsaw Puzzles5e0d964bf1ac4e0acdf66d9cMozilla/5.0 (Linux; Android 12; SM-A127M Build/SP1A.210812.016; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-19.0131-47.0679braminas gerais177.85.3.199samsungANE-LX2Jandroid12d76ba243-1670-4fc3-9648-997a405d2eb5Chartboost-Android-SDK2025-05-07T16:44:05.615-04:00
12805435-500.0011116USDcom.paper.princess.dress.up.gamesPaper Princess - Doll Dress Up98607731Dalvik/2.1.0 (Linux; U; Android 13; moto g52 Build/T2SRS33.72-22-4-11)-23.71-46.55brasão paulo190.171.74.253motorolaGeneric Androidandroid13a9896f3c-d9df-48bb-9d5c-0c0e6dab34c4Yandex Mobile Ads SDK2025-05-07T16:44:05.618-04:00
1658a99e8c6c8025e1082d40c9fd76f0d0.013333333USDball.sort.water.puzzleBall Sort1cba00b109ec913bb7163240a59ec57cMozilla/5.0 (Linux; Android 13; Infinix X6525B Build/TP1A.220624.014; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-29.9854-51.0364brario grande do sul200.102.215.139infinixL78011android13e2518923-c035-4b0d-b404-59c1862b89e7adx2025-05-07T16:44:05.618-04:00
1pubnative_82e8de94-da55-4aac-8c2c-97fc1893154a0.0321USD1617391485App1008551pubnative_1008551Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-25.51-49.3braparaná177.92.54.4appleiPhoneios1894fb6672-d7ed-4554-a9f6-9d16786624e4APS2025-05-07T16:44:05.619-04:00
19693798-9111.11117973USDcom.vitastudio.mahjongVita Mahjong106737652Dalvik/2.1.0 (Linux; U; Android 13; SM-A515F Build/TP1A.220624.014)-23.54-46.64brasão paulo187.11.39.84samsungGeneric Androidandroid13a8e1bae1-c610-4898-b4e9-82b1e020a332Yandex Mobile Ads SDK2025-05-07T16:44:05.619-04:00
1LIFTOFF_BOTTOM_IOS_NIMBUS-28219750.17USD1176147574Sofascore IOS67b5b2c077bd1c00117b9adcMozilla/5.0 (iPhone; CPU iPhone OS 18_3_2 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-10.1925-37.5367brasergipe168.227.75.230appleiPhoneios14F7ACD519-1814-4D97-8A0A-3231A2D1680EVungle2025-05-07T16:44:05.619-04:00
1SEARCH_VIDEO_RESULT2_BANNER_20250225_EXP-47733380.15USDcom.snaptube.premiumSnaptube575d1c861295e1447c0000e5Mozilla/5.0 (Linux; Android 14; SM-A155M Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.113 Mobile Safari/537.36-23.673-46.5302brasão paulo187.2.174.85samsungANE-LX2Jandroid14f52cd1dc-9cc4-4e7c-852f-8d8de8952012VungleDroid2025-05-07T16:44:05.619-04:00
19c4a1207371013de7506b3637da34c710.83183391USDcom.staytodo.demolistPlanDone Listef01b57da706630bb866071d3d859da4Dalvik/2.1.0 (Linux; U; Android 8.0.0; SM-G570M Build/R16NW)-14.8598-42.9918braminas gerais179.124.220.237samsungSM-G570Mandroid8.0.04f2d013c-50a0-4ebd-b1e5-67465d9d1b0aadx2025-05-07T16:44:05.619-04:00
1YOUTUBE_DETAILS_TOP_BANNER_NEW_FS-96493210.15USDcom.snaptube.premiumSnaptube575d1c861295e1447c0000e5Mozilla/5.0 (Linux; Android 13; SM-G780G Build/TP1A.220624.014; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-8.4438-35.0619brapernambuco186.233.111.186samsungANE-LX2Jandroid13d9e35cb2-30f7-466e-a595-ce78708c25a8VungleDroid2025-05-07T16:44:05.619-04:00
1car.jam.traffic.seat.unblock-mraid100.0USDcar.jam.traffic.seat.unblockCar Jam4419624Mozilla/5.0 (Linux; Android 15; 23129RA5FL Build/AQ3A.240829.003; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-23.6301-46.6378brasão paulo177.81.79.44xiaomi6045Yandroid154e3d39d4-8786-4979-81b5-d452a8c1e8bcunity sdk2025-05-07T16:44:05.620-04:00
114421160.12USD498477945Moovit: Bus & Transit Tracker217016Mozilla/5.0 (iPhone; CPU iPhone OS 16_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-8.0009-34.8687brapernambuco189.40.101.58appleiPhoneios13595F56C5-72E5-450C-ADE3-E65F0ED5B5CAFyber2025-05-07T16:44:05.620-04:00
1pubnative_912671f5-0b1f-48fa-8534-7b1ab3bf53690.0321USD1617391485App1008551pubnative_1008551Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-22.8951-47.0439brasão paulo191.59.116.157appleiPhoneios140c115fe1-5c45-4d96-818b-85bebf826bccapplovin2025-05-07T16:44:05.620-04:00
1zmaticoo_25177560.023326USD6482849843Goods Puzzle: Sort Challengezmaticoo_5135195Mozilla/5.0 (iPhone; CPU iPhone OS 18_3_2 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-23.1808-45.8911brasão paulo177.51.222.30appleiPhoneios1434a71fab-9e9a-4f1a-bb29-1880d0254164applovin2025-05-07T16:44:05.621-04:00
1BLOCK_A_BANNER_BIDDING-01557660.02USDcom.fungames.blockcraftBlock Craft: City Building Simulator - Android561e8d976b8d90f61a00418eMozilla/5.0 (Linux; Android 14; SM-A146M Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-10.5388-38.4214brabahia177.155.151.225samsungANE-LX2Jandroid14ed445aec-d6d8-4e9f-a7ba-8ac587a9192aVungleDroid2025-05-07T16:44:05.621-04:00
111694145-210.0011116USDcom.bbg.drwaonepuzzle.drawline.braingames.brainpuzzle.braintestDraw One Puzzle: DOP Game105880557Dalvik/2.1.0 (Linux; U; Android 12; SM-M127F Build/SP1A.210812.016)-22.8951-47.0439brasão paulo187.106.43.98samsungGeneric Androidandroid125c1424f4-59b5-4d34-a0c9-4d3e06adec22Yandex Mobile Ads SDK2025-05-07T16:44:05.622-04:00
123943480.101333USD998411110AirBrush: Face Photo Editor24362Mozilla/5.0 (iPhone; CPU iPhone OS 18_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148-19.9029-43.9572braminas gerais179.0.73.245appleiPhoneios18.4.14E78645C-E9EA-4696-8084-F27B3E260A55unity sdk2025-05-07T16:44:05.623-04:00
127359522.68USDai.socialapps.speakmasterPolyBuzz: Chat with AI Friends228005Mozilla/5.0 (Linux; Android 14; SM-A356E Build/UP1A.231005.007; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/135.0.7049.111 Mobile Safari/537.36-28.0606-52.0101brario grande do sul177.92.187.241samsungANE-LX2Jandroid1499d16308-59ec-4677-ba20-81fda9e9b70aFyber2025-05-07T16:44:05.625-04:00
1d28ea9228ad7b66061fd845c096e53550.12USDcom.jogatina.trancaTranca9ca9a174f0ee5b646fb8a56a6734e204Mozilla/5.0 (Linux; Android 14; CPH2557 Build/UP1A.230620.001; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/130.0.6723.107 Mobile Safari/537.36-23.6301-46.6378brasão paulo179.110.27.248oppoPSP3503DUOandroid144b53327b-42ba-4692-a150-608f5c60fd89adx2025-05-07T16:44:05.625-04:00

info upon data

actually the valuable columns for us are:

  • IFA: its actually a Device ID (IDFA for apple, GAID for Andorid), it should be the same for all ad-bids done for one device
  • IP: actual user ip, if its not a mobile carrier - we can use it to match home ip
  • UserAgent: it could be used to identify user together with ip

it means that we have 2 signatures, that we can use to identify a user: ifa or ip + useragent.

Within that we can group bid data to get userprofiles, but we need to somehow to merge it with "db sample". And here is the problem. We have no neither ip or ifa in enrichment db. We can get a mobile carrier data from sample db, but its a bit too common. It means, that if we does not control the ad launch, and just read somebody else data - we don't have a point to connect enrichment data to ifa (except too big groups, like mobile carrier)

like:

AttributeBidStream dataEnrichment DBMatch Status
IFA / Device IDPresentMissingNo match
IP AddressPresentMissingNo match
UserAgentPresentMissingNo match
Mobile CarrierPresentPresentToo common

We need more data in Enrichment DB, because currently even using probabilistic approach the match will be too broad.

Note: iceberg catalog (like CloudFlare R2 data catalog) is the cheapest solution for storing bidstream, like good solution to store and process lots of data using S3 like storage.

Note: regarding lat and long data in bidstream: unfortunately it's an ip to geo. It means that this data is not matching real user location, it's just geoip.