Software-defined Software:a PerspectiveofMachineLearningbasedSoftware Production
Software-defined Software: a Perspective of Machine Learning based Software Production 1
Software Productionisfacing Two Challenges·Increasing complexities of both hardware and software:Many new devices are merging into existing computing systems: Highly optimized software needs deep understanding of both:Newhardwarearchitecture,and.Domainspecificknowledge·Increasing shortageofsoftware developers:Unbalanced demand and supply,in both quantity and quality: A parallel programming expert needs a training at a Ph.D. level
Software Production is facing Two Challenges • Increasing complexities of both hardware and software • Many new devices are merging into existing computing systems • Highly optimized software needs deep understanding of both • New hardware architecture, and • Domain specific knowledge • Increasing shortage of software developers • Unbalanced demand and supply, in both quantity and quality • A parallel programming expert needs a training at a Ph.D. level 2
Moore'sLawis reachingtothe endMasteringMoore'sLawCorei510billion1.3billionIntel'sprogressinpackingmoreIntelCore2Duotransistorsonmainstream1billion410millionmicroprocessorchips100millionPentium4Core15Logarithmicscale125millionLObillion10millionPentium1million3.1million100,00010,000Cintel(intel)1,000Core2DuoCore"i540041002,300transistors1011971'80'90'102000*UpgradedversionsofpriormodelsTHEWALLSTREETJOURNALSource:IntelWe are closing to the final usable size limit a transistor gate length: 5 nm (2020)Minimum costpertransistorhasbeenup since32nm (2010)Road map:22 nm in 2012, 14 nm in 2014, 10 nm in 2017, 7 nm 20183
Moore’s Law is reaching to the end We are closing to the final usable size limit a transistor gate length: 5 nm (2020) Minimum cost per transistor has been up since 32 nm (2010) Road map: 22 nm in 2012, 14 nm in 2014, 10 nm in 2017, 7 nm 2018 3
Apowerfulandgeneralpurposeecosystem·A simple and one-size-fit-all computing abstraction:Any computingtask is expressed byprogramsand executedbyIsA:Ataskisdividedbyasequenceof standardexecutiontimeunit.Undermultiprogramming model, Os assignstime unitto eachtaskbyturnsDatablocksaremovedaroundinthememoryhierarchy.Programmingisveryflexible.Moore's law has hidden dark side ofthe conventional ecosystem.EfficiencyconfinuesfobecomelowinbothpowerandexecutionNotinclusivetoothermodes,e.g.simD,dataflow,and domainspecific·AsMoore'slawisending:General-purpose computing needs a lot ofexternal help.One-size-fit-all abstraction isno longerthe only choice
A powerful and general purpose ecosystem • A simple and one-size-fit-all computing abstraction • Any computing task is expressed by programs and executed by ISA • A task is divided by a sequence of standard execution time unit • Under multiprogramming model, OS assigns time unit to each task by turns • Data blocks are moved around in the memory hierarchy • Programming is very flexible • Moore’s law has hidden dark side of the conventional ecosystem • Efficiency continues to become low in both power and execution • Not inclusive to other modes, e.g. SIMD, data flow, and domain specific • As Moore’s law is ending • General-purpose computing needs a lot of external help • One-size-fit-all abstraction is no longer the only choice 4
IncreasingShortageofSoftwareDevelopers1,400,0001200,000$5o0billionopportunity1000,000800,0001.4million600,000computingjobs400,000200,000400.000computerscience students201220132014201520162018201920120172020Sources:NationalBureauofLaborStatists,NsF,andBayAreaCouncilofEconomicsInstitute5
Increasing Shortage of Software Developers Sources: National Bureau of Labor Statists, NSF, and Bay Area Council of Economics Institute. 5