SlideShare a Scribd company logo
1 of 26
1
Optimization System Architecture
2015/07/28 BPStudy#95
Kaizen Platform, Inc. @dtaniwaki
2
About dtaniwaki
2008 - 2011 : Trend Micro (in Taiwan)
2011 - 2014 : Tabelog, Inc. (in New York)
2014 - : Kaizen Platform, Inc. (in Tokyo)
Computer Language : Ruby on Rails, Node JS, C, C++ and etc.
Human Language : English, Chinese, Spanish (un poco)
Interest : Scuba Diving, Rugby, Yoga
Github : https://github.com/dtaniwaki
3
What is Kaizen Platform?
ROI Optimization PlatformA/B Testing Tool
4
Basic Optimization
5
VariationsOriginal
Web Optimization
Distribution Ratio
Original
Variation A
Variation B
Variation C
Variation D
A B
C D The best variation!
6
Web Optimization Steps
✓ Generate JavaScript with the test condition
✓ Attach it on the customer’s page
✓ Collect visit logs by the pixel
✓ Collect conversion logs by the pixel
✓ Calculate the distribution ratio
✓ Update the JavaScript with the ratio
7
Customer B
Customer A
LP / CV
Web Optimization Architecture
JavaScript
Template
LP / CV
Creatives
Creatives
Log App
Log Storage App
Test
Condition
Distribution
Ratio
Test
Condition
Distribution
Ratio
Visit / Conversion Log
Generate
Generate
1st Party
1st Party
8
Creatives
AD Optimization
The best creatives!
9
AD Optimization Steps
✓ Generate JavaScript
✓ Submit it as 3PAS
✓ Collect impression logs by the pixel
✓ Collect click logs through the redirector
✓ Collect conversion logs by the pixel
✓ Calculate the distribution ratio
✓ Stop low performance creatives
10
AD Optimization Architecture
JavaScript
Template
Media (3PAS)Creatives
Log App
Log Storage App
Distribution
Ratio
Impression / Conversion Log
LP
Redirector
CV
Click Log
3rd Party
3rd Party
Generate
Generate
11
AD x Web Optimization
AD Optimization Web Optimization
Maximize the inbound Optimize with clicked banners
12
AD x Web Optimization Steps
✓ Memorize the clicked banner ID through the redirector
✓ Get the clicked banner ID by XHR
✓ Collect logs with clicked banner ID
✓ Get the result of clicked banner by the ID
13
Web x AD Optimization Architecture
Media (3PAS)
LP
Redirector
CV
Cookie Sync APIGet clicked Banner ID
AD Apps
Web Apps
Visit / Conversion Log w/ Banner ID
Get results by Banner ID
1st Party
1st Party
3rd Party
Impression / Click Log
3rd Party
Generate
Generate
Generate
14
Basic Optimization Issues
15
Legacy Optimization
A
Creatives Audiences
B
C D
CVR 30% CVR 15%
CVR 20% CVR 5%
Distribute
based on
CVR
16
Legacy Optimization Issue
✓ The distribution ratio is calculated by overall CVR
✓ Each audience has different feeling on creatives
17
Per-Segment Optimization
Male 30sFemale 30s
Male 40sFemale 40s
A
Creatives Audiences
Gender
Age
Gender
Age
B
C D
Female 30s Male 30s
Male 40sFemale 40s
Distribute Creatives
based on segments
18
Per-Segment Optimization Steps
✓ Collect logs with audience segments
✓ Calculate the distribution ratio per segment
✓ Choose creative based on the distribution ratio of their segments
19
Per-Segment Optimization Architecture
Log App Log Storage App Creatives
Distribution
Ratio for
Segment A
Distribution
Ratio for
Segment B
Distribution
Ratio for
Segment C
Distribution
Ratio for
Segment D
Log with Segment
LP
Generate
Calculate per segment
20
Per-Segment Optimization Issue
✓ Hard to choose from segment combinations
○ Ideal case
e.g. “Male 30s”, “Female 30s”, “Male 40s” and “Female 40s”
○ Difficult case
e.g. “Male”, “Female”, “30s”, “40s”
“Male” x “30s”, “Male” x “40s”, “Female” x “30s”, “Female” x “40s”
21
Kaizen Optimization Platform
(a.k.a. CVR Predictor)
22
Kaizen Optimization Platform
Female x 30s
Male x 50s
Female x 40s
A
B
A: 70%
B: 30%
Male x 40s B
Female x 50s A
…
Big Data
Machine Learning
23
Kaizen Optimization Platform Steps
✓ Set up a scheduled batch task
✓ Upload the content into the storage
✓ Collect logs with audience segments
✓ Calculate the coefficients of estimated CVR based on the audience
segments
✓ Choose the best creative based on the audience segments on the fly
24
Kaizen Optimization Platform Architecture
Audience
Kaizen Optimization Platform
Log Server
App ServerKaizen KVS Kaizen Predictor
Log Storage
Kaizen Test API
Web
Optimization
Platform
Prediction Batch
AD Optimization
Platform
Bandit Algorithm
Machine Learning
AD Log App
Round API
Variation API
CVR Prediction
UUID Segments Round Variation CV
ABCX Male, 30s R1 V1 1
ABCY Female, 20s R1 V2 0
...
R1 Coefficients
V1: { a: 0.8, b1: 0.3, b2: 0.6 }
V2: { a: 0.3, b1: 0.1, b2: 0.4 }
R1
Batch Options
for R1
Send log w/
segments
Dispatc
h
Web Log App
V1
V2
V1
AD JS Web JS
25
Per-Audience Optimization
Device
Access Time
Access DoW
DMP
Clicked
Banner
Language
CRM
Female
40s
Clicked
Banner A
Friday
Japanese Tokyo
Gender
Age
Place
26
Thank You!

More Related Content

What's hot

Accelerating ABM Impact: What's Working, Whats's Next
Accelerating ABM Impact: What's Working, Whats's NextAccelerating ABM Impact: What's Working, Whats's Next
Accelerating ABM Impact: What's Working, Whats's NextDemandbase
 
New Priorities for ABM: Benchmarks and Best Practices for 2021
New Priorities for ABM: Benchmarks and Best Practices for 2021New Priorities for ABM: Benchmarks and Best Practices for 2021
New Priorities for ABM: Benchmarks and Best Practices for 2021Demandbase
 
CMO Connect: I Predicted Marketing Automation | Jon Miller, CMO, Demandbase
CMO Connect: I Predicted Marketing Automation | Jon Miller, CMO, DemandbaseCMO Connect: I Predicted Marketing Automation | Jon Miller, CMO, Demandbase
CMO Connect: I Predicted Marketing Automation | Jon Miller, CMO, DemandbaseDemandbase
 
ABM Master Class: Engagement
ABM Master Class: EngagementABM Master Class: Engagement
ABM Master Class: EngagementDemandbase
 
Analog Strategies For ABM Success: Digital Channels And Integrated Programs 
Analog Strategies For ABM Success: Digital Channels And Integrated Programs Analog Strategies For ABM Success: Digital Channels And Integrated Programs 
Analog Strategies For ABM Success: Digital Channels And Integrated Programs G3 Communications
 
Three Ways High Growth Companies Can Drive ABM Results
Three Ways High Growth Companies Can Drive ABM ResultsThree Ways High Growth Companies Can Drive ABM Results
Three Ways High Growth Companies Can Drive ABM ResultsDemandbase
 
Intent is the New Lead: Understanding Intent Data Along the Buyer's Journey
Intent is the New Lead: Understanding Intent Data Along the Buyer's JourneyIntent is the New Lead: Understanding Intent Data Along the Buyer's Journey
Intent is the New Lead: Understanding Intent Data Along the Buyer's JourneyDemandbase
 
ABM Master Class: Sales Success
ABM Master Class: Sales SuccessABM Master Class: Sales Success
ABM Master Class: Sales SuccessDemandbase
 
ABM Outside the Box: How to Woo, Wow, and Win with Demand Innovation for Valu...
ABM Outside the Box: How to Woo, Wow, and Win with Demand Innovation for Valu...ABM Outside the Box: How to Woo, Wow, and Win with Demand Innovation for Valu...
ABM Outside the Box: How to Woo, Wow, and Win with Demand Innovation for Valu...Demandbase
 
ABM Master Class: Sales Secrets for Pipeline Hyper-Growth
ABM Master Class: Sales Secrets for Pipeline Hyper-GrowthABM Master Class: Sales Secrets for Pipeline Hyper-Growth
ABM Master Class: Sales Secrets for Pipeline Hyper-GrowthDemandbase
 
DemandCon 2013: Kapost, inContact and Demandbase on Content Marketing
DemandCon 2013: Kapost, inContact and Demandbase on Content MarketingDemandCon 2013: Kapost, inContact and Demandbase on Content Marketing
DemandCon 2013: Kapost, inContact and Demandbase on Content MarketingKapost
 
Get Out of the Tactical Reporting Trenches and into ABM Analytics Bliss
Get Out of the Tactical Reporting Trenches and into ABM Analytics BlissGet Out of the Tactical Reporting Trenches and into ABM Analytics Bliss
Get Out of the Tactical Reporting Trenches and into ABM Analytics BlissDelaneyKutsal
 
As Easy As ABX
As Easy As ABX As Easy As ABX
As Easy As ABX Demandbase
 
Demandbase + Engagio, A Match Made in ABM
Demandbase + Engagio, A Match Made in ABMDemandbase + Engagio, A Match Made in ABM
Demandbase + Engagio, A Match Made in ABMDemandbase
 
ABM Master Class: Analytics
ABM Master Class: AnalyticsABM Master Class: Analytics
ABM Master Class: AnalyticsDemandbase
 
Preparing for Reopening: Success in 2021 and Beyond!
Preparing for Reopening: Success in 2021 and Beyond!Preparing for Reopening: Success in 2021 and Beyond!
Preparing for Reopening: Success in 2021 and Beyond!Megan Black
 
The Future of Demand: What to Expect in the Next 1, 5 and 10 Years
The Future of Demand: What to Expect in the Next 1, 5 and 10 YearsThe Future of Demand: What to Expect in the Next 1, 5 and 10 Years
The Future of Demand: What to Expect in the Next 1, 5 and 10 YearsDemandbase
 
Driving Results through Advertising for an ABM Strategy
Driving Results through Advertising for an ABM StrategyDriving Results through Advertising for an ABM Strategy
Driving Results through Advertising for an ABM StrategyDemandbase
 
Fundamentals of ABM: Preparing your Organization for ABM Success
Fundamentals of ABM: Preparing your Organization for ABM SuccessFundamentals of ABM: Preparing your Organization for ABM Success
Fundamentals of ABM: Preparing your Organization for ABM SuccessDemandbase
 
5 Traits of Top ABM Programs and 3 Pitfalls to Avoid
5 Traits of Top ABM Programs and 3 Pitfalls to Avoid5 Traits of Top ABM Programs and 3 Pitfalls to Avoid
5 Traits of Top ABM Programs and 3 Pitfalls to AvoidDemandbase
 

What's hot (20)

Accelerating ABM Impact: What's Working, Whats's Next
Accelerating ABM Impact: What's Working, Whats's NextAccelerating ABM Impact: What's Working, Whats's Next
Accelerating ABM Impact: What's Working, Whats's Next
 
New Priorities for ABM: Benchmarks and Best Practices for 2021
New Priorities for ABM: Benchmarks and Best Practices for 2021New Priorities for ABM: Benchmarks and Best Practices for 2021
New Priorities for ABM: Benchmarks and Best Practices for 2021
 
CMO Connect: I Predicted Marketing Automation | Jon Miller, CMO, Demandbase
CMO Connect: I Predicted Marketing Automation | Jon Miller, CMO, DemandbaseCMO Connect: I Predicted Marketing Automation | Jon Miller, CMO, Demandbase
CMO Connect: I Predicted Marketing Automation | Jon Miller, CMO, Demandbase
 
ABM Master Class: Engagement
ABM Master Class: EngagementABM Master Class: Engagement
ABM Master Class: Engagement
 
Analog Strategies For ABM Success: Digital Channels And Integrated Programs 
Analog Strategies For ABM Success: Digital Channels And Integrated Programs Analog Strategies For ABM Success: Digital Channels And Integrated Programs 
Analog Strategies For ABM Success: Digital Channels And Integrated Programs 
 
Three Ways High Growth Companies Can Drive ABM Results
Three Ways High Growth Companies Can Drive ABM ResultsThree Ways High Growth Companies Can Drive ABM Results
Three Ways High Growth Companies Can Drive ABM Results
 
Intent is the New Lead: Understanding Intent Data Along the Buyer's Journey
Intent is the New Lead: Understanding Intent Data Along the Buyer's JourneyIntent is the New Lead: Understanding Intent Data Along the Buyer's Journey
Intent is the New Lead: Understanding Intent Data Along the Buyer's Journey
 
ABM Master Class: Sales Success
ABM Master Class: Sales SuccessABM Master Class: Sales Success
ABM Master Class: Sales Success
 
ABM Outside the Box: How to Woo, Wow, and Win with Demand Innovation for Valu...
ABM Outside the Box: How to Woo, Wow, and Win with Demand Innovation for Valu...ABM Outside the Box: How to Woo, Wow, and Win with Demand Innovation for Valu...
ABM Outside the Box: How to Woo, Wow, and Win with Demand Innovation for Valu...
 
ABM Master Class: Sales Secrets for Pipeline Hyper-Growth
ABM Master Class: Sales Secrets for Pipeline Hyper-GrowthABM Master Class: Sales Secrets for Pipeline Hyper-Growth
ABM Master Class: Sales Secrets for Pipeline Hyper-Growth
 
DemandCon 2013: Kapost, inContact and Demandbase on Content Marketing
DemandCon 2013: Kapost, inContact and Demandbase on Content MarketingDemandCon 2013: Kapost, inContact and Demandbase on Content Marketing
DemandCon 2013: Kapost, inContact and Demandbase on Content Marketing
 
Get Out of the Tactical Reporting Trenches and into ABM Analytics Bliss
Get Out of the Tactical Reporting Trenches and into ABM Analytics BlissGet Out of the Tactical Reporting Trenches and into ABM Analytics Bliss
Get Out of the Tactical Reporting Trenches and into ABM Analytics Bliss
 
As Easy As ABX
As Easy As ABX As Easy As ABX
As Easy As ABX
 
Demandbase + Engagio, A Match Made in ABM
Demandbase + Engagio, A Match Made in ABMDemandbase + Engagio, A Match Made in ABM
Demandbase + Engagio, A Match Made in ABM
 
ABM Master Class: Analytics
ABM Master Class: AnalyticsABM Master Class: Analytics
ABM Master Class: Analytics
 
Preparing for Reopening: Success in 2021 and Beyond!
Preparing for Reopening: Success in 2021 and Beyond!Preparing for Reopening: Success in 2021 and Beyond!
Preparing for Reopening: Success in 2021 and Beyond!
 
The Future of Demand: What to Expect in the Next 1, 5 and 10 Years
The Future of Demand: What to Expect in the Next 1, 5 and 10 YearsThe Future of Demand: What to Expect in the Next 1, 5 and 10 Years
The Future of Demand: What to Expect in the Next 1, 5 and 10 Years
 
Driving Results through Advertising for an ABM Strategy
Driving Results through Advertising for an ABM StrategyDriving Results through Advertising for an ABM Strategy
Driving Results through Advertising for an ABM Strategy
 
Fundamentals of ABM: Preparing your Organization for ABM Success
Fundamentals of ABM: Preparing your Organization for ABM SuccessFundamentals of ABM: Preparing your Organization for ABM Success
Fundamentals of ABM: Preparing your Organization for ABM Success
 
5 Traits of Top ABM Programs and 3 Pitfalls to Avoid
5 Traits of Top ABM Programs and 3 Pitfalls to Avoid5 Traits of Top ABM Programs and 3 Pitfalls to Avoid
5 Traits of Top ABM Programs and 3 Pitfalls to Avoid
 

Viewers also liked

Enduring CSS
Enduring CSSEnduring CSS
Enduring CSSTakazudo
 
MySQL 5.7 InnoDB 日本語全文検索
MySQL 5.7 InnoDB 日本語全文検索MySQL 5.7 InnoDB 日本語全文検索
MySQL 5.7 InnoDB 日本語全文検索yoyamasaki
 
Bluepillを使ったiOS自動テストの並列化
Bluepillを使ったiOS自動テストの並列化Bluepillを使ったiOS自動テストの並列化
Bluepillを使ったiOS自動テストの並列化Toshiyuki Hirata
 
Are we doing things for live
Are we doing things for liveAre we doing things for live
Are we doing things for liveWily Pietro
 
Crucial Dialogue Model 2016
Crucial Dialogue Model 2016Crucial Dialogue Model 2016
Crucial Dialogue Model 2016Johan Roels
 
전국 대안학교*교육 유형별 정리 및 현황
전국 대안학교*교육 유형별 정리 및 현황전국 대안학교*교육 유형별 정리 및 현황
전국 대안학교*교육 유형별 정리 및 현황gidokhan
 
Polling Tingkat Kepuasan Kinerja Pemprov DKI Jakarta 22-24 Februari 2017
Polling Tingkat Kepuasan Kinerja Pemprov DKI Jakarta 22-24 Februari 2017Polling Tingkat Kepuasan Kinerja Pemprov DKI Jakarta 22-24 Februari 2017
Polling Tingkat Kepuasan Kinerja Pemprov DKI Jakarta 22-24 Februari 2017Rakyat Memilih
 
El juego y la dinamica
El juego y la dinamicaEl juego y la dinamica
El juego y la dinamicajosecariaga
 
Minimally important differences
Minimally important differencesMinimally important differences
Minimally important differencesStephen Senn
 
Valuation Of Pre Revenue Companies
Valuation Of Pre Revenue CompaniesValuation Of Pre Revenue Companies
Valuation Of Pre Revenue CompaniesDickson Consulting
 
Rethinking Refugee Birmingham Conference Roundup
Rethinking Refugee Birmingham Conference RoundupRethinking Refugee Birmingham Conference Roundup
Rethinking Refugee Birmingham Conference RoundupAshleyCommunityHousing
 
Completion Biotech Manuel Concepcion @xemide @xcupware
Completion Biotech Manuel Concepcion @xemide @xcupwareCompletion Biotech Manuel Concepcion @xemide @xcupware
Completion Biotech Manuel Concepcion @xemide @xcupwareDr. Manuel Concepción
 
PHP 7.x - past, present, future
PHP 7.x - past, present, futurePHP 7.x - past, present, future
PHP 7.x - past, present, futureBoyan Yordanov
 
Centering the User in Your Lean Content Strategy
Centering the User in Your Lean Content Strategy Centering the User in Your Lean Content Strategy
Centering the User in Your Lean Content Strategy Brittany VanMaele
 
Interval Type-2 fuzzy decision making
Interval Type-2 fuzzy decision makingInterval Type-2 fuzzy decision making
Interval Type-2 fuzzy decision makingBob John
 

Viewers also liked (19)

Vue.js with Go
Vue.js with GoVue.js with Go
Vue.js with Go
 
Enduring CSS
Enduring CSSEnduring CSS
Enduring CSS
 
MySQL 5.7 InnoDB 日本語全文検索
MySQL 5.7 InnoDB 日本語全文検索MySQL 5.7 InnoDB 日本語全文検索
MySQL 5.7 InnoDB 日本語全文検索
 
Bluepillを使ったiOS自動テストの並列化
Bluepillを使ったiOS自動テストの並列化Bluepillを使ったiOS自動テストの並列化
Bluepillを使ったiOS自動テストの並列化
 
Are we doing things for live
Are we doing things for liveAre we doing things for live
Are we doing things for live
 
"Africa: amor e dor"
"Africa: amor e dor" "Africa: amor e dor"
"Africa: amor e dor"
 
Crucial Dialogue Model 2016
Crucial Dialogue Model 2016Crucial Dialogue Model 2016
Crucial Dialogue Model 2016
 
전국 대안학교*교육 유형별 정리 및 현황
전국 대안학교*교육 유형별 정리 및 현황전국 대안학교*교육 유형별 정리 및 현황
전국 대안학교*교육 유형별 정리 및 현황
 
Polling Tingkat Kepuasan Kinerja Pemprov DKI Jakarta 22-24 Februari 2017
Polling Tingkat Kepuasan Kinerja Pemprov DKI Jakarta 22-24 Februari 2017Polling Tingkat Kepuasan Kinerja Pemprov DKI Jakarta 22-24 Februari 2017
Polling Tingkat Kepuasan Kinerja Pemprov DKI Jakarta 22-24 Februari 2017
 
El juego y la dinamica
El juego y la dinamicaEl juego y la dinamica
El juego y la dinamica
 
Minimally important differences
Minimally important differencesMinimally important differences
Minimally important differences
 
Valuation Of Pre Revenue Companies
Valuation Of Pre Revenue CompaniesValuation Of Pre Revenue Companies
Valuation Of Pre Revenue Companies
 
Rethinking Refugee Birmingham Conference Roundup
Rethinking Refugee Birmingham Conference RoundupRethinking Refugee Birmingham Conference Roundup
Rethinking Refugee Birmingham Conference Roundup
 
Steve Rhodes Resume/Bio/Career Interests 2017
Steve Rhodes Resume/Bio/Career Interests 2017Steve Rhodes Resume/Bio/Career Interests 2017
Steve Rhodes Resume/Bio/Career Interests 2017
 
Completion Biotech Manuel Concepcion @xemide @xcupware
Completion Biotech Manuel Concepcion @xemide @xcupwareCompletion Biotech Manuel Concepcion @xemide @xcupware
Completion Biotech Manuel Concepcion @xemide @xcupware
 
PHP 7.x - past, present, future
PHP 7.x - past, present, futurePHP 7.x - past, present, future
PHP 7.x - past, present, future
 
Centering the User in Your Lean Content Strategy
Centering the User in Your Lean Content Strategy Centering the User in Your Lean Content Strategy
Centering the User in Your Lean Content Strategy
 
Interval Type-2 fuzzy decision making
Interval Type-2 fuzzy decision makingInterval Type-2 fuzzy decision making
Interval Type-2 fuzzy decision making
 
Austin Oncology
Austin OncologyAustin Oncology
Austin Oncology
 

Similar to Kaizen Platform Optimization System Architecture

Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...Daniel Caridi
 
How To Maximise ROI With Creative Optimization
How To Maximise ROI With Creative OptimizationHow To Maximise ROI With Creative Optimization
How To Maximise ROI With Creative OptimizationironSource
 
Preparing for AI - Measurefest
Preparing for AI - MeasurefestPreparing for AI - Measurefest
Preparing for AI - MeasurefestGuido X Jansen
 
Website Experience Webinar Presentation .pptx
Website Experience Webinar Presentation .pptxWebsite Experience Webinar Presentation .pptx
Website Experience Webinar Presentation .pptxAvishai Sharon
 
Agile + DevOps Keynote - The Evolution of a Continuous Integration Pipeline
Agile + DevOps Keynote - The Evolution of a Continuous Integration PipelineAgile + DevOps Keynote - The Evolution of a Continuous Integration Pipeline
Agile + DevOps Keynote - The Evolution of a Continuous Integration PipelineGreg Sypolt
 
How To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization StrategyHow To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization StrategyVWO
 
Lead Generation at Scale | Maximizing your lead gen potential
Lead Generation at Scale | Maximizing your lead gen potentialLead Generation at Scale | Maximizing your lead gen potential
Lead Generation at Scale | Maximizing your lead gen potentialPirate Skills
 
Roi Lavan - Convertro (All Things Data 2015)
Roi Lavan - Convertro (All Things Data 2015)Roi Lavan - Convertro (All Things Data 2015)
Roi Lavan - Convertro (All Things Data 2015)Shuki Mann
 
Secrets from the trenches
Secrets from the trenchesSecrets from the trenches
Secrets from the trenchesVWO
 
ProjectEDU - 5 Mind Blowing Analytics Reports
ProjectEDU - 5 Mind Blowing Analytics ReportsProjectEDU - 5 Mind Blowing Analytics Reports
ProjectEDU - 5 Mind Blowing Analytics ReportsBrice McBeth
 
PyParis2017 / Machine learning to moderate classifieds, by Vaibhav Singh
PyParis2017 / Machine learning to moderate classifieds, by Vaibhav SinghPyParis2017 / Machine learning to moderate classifieds, by Vaibhav Singh
PyParis2017 / Machine learning to moderate classifieds, by Vaibhav SinghPôle Systematic Paris-Region
 
Criteo TektosData Meetup
Criteo TektosData MeetupCriteo TektosData Meetup
Criteo TektosData MeetupOlivier Koch
 
Measure Right the First Time - Infusionsoft Partnercon
Measure Right the First Time - Infusionsoft PartnerconMeasure Right the First Time - Infusionsoft Partnercon
Measure Right the First Time - Infusionsoft PartnerconVuurr
 
7 Years of DDD: Tackling Complexity in Marketing Systems (DDD Europe 2018)
7 Years of DDD: Tackling Complexity in Marketing Systems (DDD Europe 2018)7 Years of DDD: Tackling Complexity in Marketing Systems (DDD Europe 2018)
7 Years of DDD: Tackling Complexity in Marketing Systems (DDD Europe 2018)Vladik Khononov
 
CRO Service Proposal Powerpoint Presentation Slides
CRO Service Proposal Powerpoint Presentation SlidesCRO Service Proposal Powerpoint Presentation Slides
CRO Service Proposal Powerpoint Presentation SlidesSlideTeam
 
Web Site L10n 101
Web Site L10n 101Web Site L10n 101
Web Site L10n 101jsoloduk
 
Adobe Business.pptx
Adobe Business.pptxAdobe Business.pptx
Adobe Business.pptxAnkush Kapil
 
Twin Cities Eloqua User Group 092413
Twin Cities Eloqua User Group 092413Twin Cities Eloqua User Group 092413
Twin Cities Eloqua User Group 092413Ron Corbisier
 
Beyond DevOps: Finding Value through Requirements
Beyond DevOps: Finding Value through RequirementsBeyond DevOps: Finding Value through Requirements
Beyond DevOps: Finding Value through RequirementsGail Murphy
 

Similar to Kaizen Platform Optimization System Architecture (20)

Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
 
How To Maximise ROI With Creative Optimization
How To Maximise ROI With Creative OptimizationHow To Maximise ROI With Creative Optimization
How To Maximise ROI With Creative Optimization
 
The Evolution Of Lead Scoring
The Evolution Of Lead ScoringThe Evolution Of Lead Scoring
The Evolution Of Lead Scoring
 
Preparing for AI - Measurefest
Preparing for AI - MeasurefestPreparing for AI - Measurefest
Preparing for AI - Measurefest
 
Website Experience Webinar Presentation .pptx
Website Experience Webinar Presentation .pptxWebsite Experience Webinar Presentation .pptx
Website Experience Webinar Presentation .pptx
 
Agile + DevOps Keynote - The Evolution of a Continuous Integration Pipeline
Agile + DevOps Keynote - The Evolution of a Continuous Integration PipelineAgile + DevOps Keynote - The Evolution of a Continuous Integration Pipeline
Agile + DevOps Keynote - The Evolution of a Continuous Integration Pipeline
 
How To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization StrategyHow To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization Strategy
 
Lead Generation at Scale | Maximizing your lead gen potential
Lead Generation at Scale | Maximizing your lead gen potentialLead Generation at Scale | Maximizing your lead gen potential
Lead Generation at Scale | Maximizing your lead gen potential
 
Roi Lavan - Convertro (All Things Data 2015)
Roi Lavan - Convertro (All Things Data 2015)Roi Lavan - Convertro (All Things Data 2015)
Roi Lavan - Convertro (All Things Data 2015)
 
Secrets from the trenches
Secrets from the trenchesSecrets from the trenches
Secrets from the trenches
 
ProjectEDU - 5 Mind Blowing Analytics Reports
ProjectEDU - 5 Mind Blowing Analytics ReportsProjectEDU - 5 Mind Blowing Analytics Reports
ProjectEDU - 5 Mind Blowing Analytics Reports
 
PyParis2017 / Machine learning to moderate classifieds, by Vaibhav Singh
PyParis2017 / Machine learning to moderate classifieds, by Vaibhav SinghPyParis2017 / Machine learning to moderate classifieds, by Vaibhav Singh
PyParis2017 / Machine learning to moderate classifieds, by Vaibhav Singh
 
Criteo TektosData Meetup
Criteo TektosData MeetupCriteo TektosData Meetup
Criteo TektosData Meetup
 
Measure Right the First Time - Infusionsoft Partnercon
Measure Right the First Time - Infusionsoft PartnerconMeasure Right the First Time - Infusionsoft Partnercon
Measure Right the First Time - Infusionsoft Partnercon
 
7 Years of DDD: Tackling Complexity in Marketing Systems (DDD Europe 2018)
7 Years of DDD: Tackling Complexity in Marketing Systems (DDD Europe 2018)7 Years of DDD: Tackling Complexity in Marketing Systems (DDD Europe 2018)
7 Years of DDD: Tackling Complexity in Marketing Systems (DDD Europe 2018)
 
CRO Service Proposal Powerpoint Presentation Slides
CRO Service Proposal Powerpoint Presentation SlidesCRO Service Proposal Powerpoint Presentation Slides
CRO Service Proposal Powerpoint Presentation Slides
 
Web Site L10n 101
Web Site L10n 101Web Site L10n 101
Web Site L10n 101
 
Adobe Business.pptx
Adobe Business.pptxAdobe Business.pptx
Adobe Business.pptx
 
Twin Cities Eloqua User Group 092413
Twin Cities Eloqua User Group 092413Twin Cities Eloqua User Group 092413
Twin Cities Eloqua User Group 092413
 
Beyond DevOps: Finding Value through Requirements
Beyond DevOps: Finding Value through RequirementsBeyond DevOps: Finding Value through Requirements
Beyond DevOps: Finding Value through Requirements
 

Recently uploaded

Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 

Recently uploaded (20)

Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector Databases
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 

Kaizen Platform Optimization System Architecture

  • 1. 1 Optimization System Architecture 2015/07/28 BPStudy#95 Kaizen Platform, Inc. @dtaniwaki
  • 2. 2 About dtaniwaki 2008 - 2011 : Trend Micro (in Taiwan) 2011 - 2014 : Tabelog, Inc. (in New York) 2014 - : Kaizen Platform, Inc. (in Tokyo) Computer Language : Ruby on Rails, Node JS, C, C++ and etc. Human Language : English, Chinese, Spanish (un poco) Interest : Scuba Diving, Rugby, Yoga Github : https://github.com/dtaniwaki
  • 3. 3 What is Kaizen Platform? ROI Optimization PlatformA/B Testing Tool
  • 5. 5 VariationsOriginal Web Optimization Distribution Ratio Original Variation A Variation B Variation C Variation D A B C D The best variation!
  • 6. 6 Web Optimization Steps ✓ Generate JavaScript with the test condition ✓ Attach it on the customer’s page ✓ Collect visit logs by the pixel ✓ Collect conversion logs by the pixel ✓ Calculate the distribution ratio ✓ Update the JavaScript with the ratio
  • 7. 7 Customer B Customer A LP / CV Web Optimization Architecture JavaScript Template LP / CV Creatives Creatives Log App Log Storage App Test Condition Distribution Ratio Test Condition Distribution Ratio Visit / Conversion Log Generate Generate 1st Party 1st Party
  • 9. 9 AD Optimization Steps ✓ Generate JavaScript ✓ Submit it as 3PAS ✓ Collect impression logs by the pixel ✓ Collect click logs through the redirector ✓ Collect conversion logs by the pixel ✓ Calculate the distribution ratio ✓ Stop low performance creatives
  • 10. 10 AD Optimization Architecture JavaScript Template Media (3PAS)Creatives Log App Log Storage App Distribution Ratio Impression / Conversion Log LP Redirector CV Click Log 3rd Party 3rd Party Generate Generate
  • 11. 11 AD x Web Optimization AD Optimization Web Optimization Maximize the inbound Optimize with clicked banners
  • 12. 12 AD x Web Optimization Steps ✓ Memorize the clicked banner ID through the redirector ✓ Get the clicked banner ID by XHR ✓ Collect logs with clicked banner ID ✓ Get the result of clicked banner by the ID
  • 13. 13 Web x AD Optimization Architecture Media (3PAS) LP Redirector CV Cookie Sync APIGet clicked Banner ID AD Apps Web Apps Visit / Conversion Log w/ Banner ID Get results by Banner ID 1st Party 1st Party 3rd Party Impression / Click Log 3rd Party Generate Generate Generate
  • 15. 15 Legacy Optimization A Creatives Audiences B C D CVR 30% CVR 15% CVR 20% CVR 5% Distribute based on CVR
  • 16. 16 Legacy Optimization Issue ✓ The distribution ratio is calculated by overall CVR ✓ Each audience has different feeling on creatives
  • 17. 17 Per-Segment Optimization Male 30sFemale 30s Male 40sFemale 40s A Creatives Audiences Gender Age Gender Age B C D Female 30s Male 30s Male 40sFemale 40s Distribute Creatives based on segments
  • 18. 18 Per-Segment Optimization Steps ✓ Collect logs with audience segments ✓ Calculate the distribution ratio per segment ✓ Choose creative based on the distribution ratio of their segments
  • 19. 19 Per-Segment Optimization Architecture Log App Log Storage App Creatives Distribution Ratio for Segment A Distribution Ratio for Segment B Distribution Ratio for Segment C Distribution Ratio for Segment D Log with Segment LP Generate Calculate per segment
  • 20. 20 Per-Segment Optimization Issue ✓ Hard to choose from segment combinations ○ Ideal case e.g. “Male 30s”, “Female 30s”, “Male 40s” and “Female 40s” ○ Difficult case e.g. “Male”, “Female”, “30s”, “40s” “Male” x “30s”, “Male” x “40s”, “Female” x “30s”, “Female” x “40s”
  • 22. 22 Kaizen Optimization Platform Female x 30s Male x 50s Female x 40s A B A: 70% B: 30% Male x 40s B Female x 50s A … Big Data Machine Learning
  • 23. 23 Kaizen Optimization Platform Steps ✓ Set up a scheduled batch task ✓ Upload the content into the storage ✓ Collect logs with audience segments ✓ Calculate the coefficients of estimated CVR based on the audience segments ✓ Choose the best creative based on the audience segments on the fly
  • 24. 24 Kaizen Optimization Platform Architecture Audience Kaizen Optimization Platform Log Server App ServerKaizen KVS Kaizen Predictor Log Storage Kaizen Test API Web Optimization Platform Prediction Batch AD Optimization Platform Bandit Algorithm Machine Learning AD Log App Round API Variation API CVR Prediction UUID Segments Round Variation CV ABCX Male, 30s R1 V1 1 ABCY Female, 20s R1 V2 0 ... R1 Coefficients V1: { a: 0.8, b1: 0.3, b2: 0.6 } V2: { a: 0.3, b1: 0.1, b2: 0.4 } R1 Batch Options for R1 Send log w/ segments Dispatc h Web Log App V1 V2 V1 AD JS Web JS
  • 25. 25 Per-Audience Optimization Device Access Time Access DoW DMP Clicked Banner Language CRM Female 40s Clicked Banner A Friday Japanese Tokyo Gender Age Place