å»ççšãäžå¿ã«å»è¬åã®è£œé ã»è²©å£²ãæãããç°èŸºäžè±è£œè¬æ ªåŒäŒç€Ÿããããžã¿ã«åã®åãçµã¿ãå éãããŠããŸããã¬ã»ãããç¹å®æ€èšºãä»è·ããŒã¿ãé»åã«ã«ããèšåºç»åãšãã£ãããªã¢ã«ã¯ãŒã«ãããŒã¿ããåæããããã®åºç€ãã¯ã©ãŠãäžã«æ§ç¯ãããã«ãMR åãã®ããžã¿ã«ããŒã±ãã£ã³ã°ããŒã¿ããå»è¬å補é ã«é¢ãããµãã©ã€ãã§ãŒã³ããŒã¿ã®çµ±åãé²ããŠããŸããã¯ã©ãŠãåºç€ãšããŠæ¡çšãããã®ã¯ Azure Databricks ã§ããããŸããMicrosoft Azure ãæäŸããããŸããŸãªãµãŒãã¹ã䜿ã£ãŠãããžã¿ã«åã«åããåºç€ã®æŽåãé²ããŠãããšãããŸãã
DX ãæ±ã«ããäžæçµå¶èšç»ãæšé²

ç°èŸºäžè±è£œè¬æ ªåŒäŒç€Ÿ
ICTãããžã¡ã³ã宀
ICTãããžã¡ã³ãã°ã«ãŒã
ã°ã«ãŒããããžã£ãŒ å°æ åŒå¹ž æ°
ãå»è¬åã®åµè£œãéããŠãäžçã®äººã ã®å¥åº·ã«è²¢ç®ããŸãããäŒæ¥çå¿µã«æ²ããåœéåµè¬äŒæ¥ãšããŠç€ŸäŒããä¿¡é ŒãããäŒæ¥ãç®æããå»ççšå»è¬åãäžå¿ãšãã補é ã»è²©å£²ãæãããç°èŸºäžè±è£œè¬ãé¢ç¯ãªãŠããã»ã¯ããŒã³ç æ²»çè¬ããç³å°¿ç æ²»çå€ããã€ç çšå»è¬åãã¯ã¯ãã³ãªã©ã®ã»ããOTC å»è¬åãšããŠèè žè¬ãæ»é€åŒ·å£®ããªã³ã¯å€ãªã©ãå±éããŠããŸãã
補è¬äŒç€ŸãšããŠãåµè£œãéããŠæ£è ã®å¥åº·ãå®ããè±ããªç掻ã«è²¢ç®ããããã«ã¯ãæ°è¬éçºã®ãªãŒãã¿ã€ã çæåãè¬äŸ¡æ¹å®ãªã©ã®ç€ŸäŒèŠè«ãžã®å¯Ÿå¿ãåµè¬ã«é¢ããããŸããŸãªããŒã¿ã®æŽ»çšãäžå¯æ¬ ã§ããããã§ç°èŸºäžè±è£œè¬ãåãå ¥ããŠããã®ããããžã¿ã«åã®åãçµã¿ã軞ãšããå€é©ã§ãããã2021ïœ2025 幎床ã®äžæçµå¶èšç»ã§ã¯ãããžã¿ã«ãããŒã¯ãŒãã«ããŒã¿åæåºç€ã®æ§ç¯ãé²ãããµãã©ã€ãã§ãŒã³ã§ã®ããŒã¿æŽ»çšãããªã¥ãŒãã§ãŒã³ã®åŒ·åãããžã¿ã«ããŒã±ãã£ã³ã°ã«ããå¶æ¥å匷åãªã©ãæšé²ããããšãæãããŸãããç°èŸºäžè±è£œè¬ ICTãããžã¡ã³ã宀ã®å°æ åŒå¹ž æ°ã¯ãå瀟ã®ããžã¿ã«æšé²ã«ã€ããŠãã説æããŸãã
ãããžã¿ã«ãã©ã³ã¹ãã©ãŒã¡ãŒã·ã§ã³ïŒDXïŒãå®çŸããããžã¿ã«åºç€ã®æ§ç¯ã«åããŠã倧ãã 4 ã€ã®åãçµã¿ãé²ããŠããŸãã1 ã€ãã¯ãããã°ããŒã¿åºç€ãåæãé«éåŠçã«ãããããŒã¿å©æŽ»çšç°å¢ã®æŽåã2 ã€ãã¯ãISO èŠæ Œå¯Ÿå¿ãšèŠåæŽåã«ããå»çæ å ±ç®¡çäœå¶ã®æŽåã3 ã€ãã¯ããžã¿ã«äººæã®è²æã4 ã€ãã¯ã¢ãã€ã«ã§ãå¿«é©ã»å®å¿ã«å©çšã§ããæ¬¡äžä»£ãããã¯ãŒã¯ã®æ§ç¯ã§ããIT éšéã®ããã·ã§ã³ã¯ãããŒã¿ãããžã¡ã³ãã®åºç€ãæŽåããªãããæ°ããªæè¡ã®æ¢çŽ¢ãé²ããããããŠããžã¿ã«ã®åãçµã¿ãããªãã³ããŠãã人æãè²æããããšã«ãããŸããïŒå°æ æ°ïŒã
DX ã«åããå ·äœçãªåãçµã¿ãšããŠããŸãçæããã®ã¯ãªã¢ã«ã¯ãŒã«ãããŒã¿ã®è§£æã§ããããªã¢ã«ã¯ãŒã«ãããŒã¿ãšã¯ãã¬ã»ãããç¹å®æ€èšºãä»è·ããŒã¿ãé»åã«ã«ããèšåºç»åãªã©ãå»çãšå»è¬åéçºã«ãŸã€ããå€çš®å€æ§ãªèšå€§ãªããŒã¿ã®ããšã§ãããªã¢ã«ã¯ãŒã«ãããŒã¿ã¯æ¥ã å¢å ããŠãããããããåéã»èç©ããçµ±åçã«è§£æããããšã§ããŸããŸãªæŽ»çšãå¯èœã«ãªããŸãã
ãŸãããªã¢ã«ã¯ãŒã«ãããŒã¿ã®è§£æãšäžŠè¡ããŠãå¶æ¥ç³»ãå«ããããžã¿ã«ããŒã±ãã£ã³ã°åºç€ã®æ§ç¯ã«ãåãçµãã ãšãããŸããåŸæ¥ãããŒã±ãã£ã³ã°ãšããã° MR ã®å»åž«ã«å¯Ÿãããã£ãŒãªã³ã°æŽ»åïŒå»è¬å説æïŒãäžå¿ã§ããããçŸåšã¯å»åž«åãæ å ±ãµã€ããªã©ã掻çšãã e ããŒã±ãã£ã³ã°ã®æŽ»çšãåºãã£ãŠããŸãããã®ããããŒã±ãã£ã³ã°ããŒã¿ãå¹ççã«åéãåæã§ããåºç€ãæ§ç¯ãããšããããã§ãããããã®ããŒã¿åæåºç€ã«æ¡çšãããã®ããMicrosoft Azureãã§ããã
èšå€§ãªãªã¢ã«ã¯ãŒã«ãããŒã¿ã®åæã«åããŠã¯ã©ãŠãã®æŽ»çšãéå§

ç°èŸºäžè±è£œè¬æ ªåŒäŒç€Ÿ
ICTãããžã¡ã³ã宀
ã°ããŒãã«ã€ã³ãã©ã°ã«ãŒã
å°Ÿïš å®é æ°
ç°èŸºäžè±è£œè¬ã§ã¯ãããŒã¿åæåºç€ãæ§ç¯ããã«ããã£ãŠã3 ã€ã®èª²é¡ãæ±ããŠãããšãããŸãã
1 ã€ã¯ãããŒã¿éãèšå€§ã§ãé©åã«åãæ±ãããã®åŠçåºç€ããªãããšã§ãããICTãããžã¡ã³ã宀ã®å°Ÿïš å®é æ°ã¯ãã話ããŸãã
ããªã¢ã«ã¯ãŒã«ãããŒã¿ã¯å€çš®å€æ§ã§ã1 ã€ã®ãã¡ã€ã«ã§ 1 ãã©ãã€ãïŒTBïŒãè¶ ãã容éã«ãªãããšããããŸããæ§é åãããããŒã¿ã§ã¯ãããŸãããã¬ã³ãŒãæ°ã 100 åä»¶ãè¶ ãããªã©ããã®ãŸãŸã§ã¯ SAS ã R ãªã©ã®åæããŒã«ã§åŠçã§ããªãããšãå€ãã£ãã®ã§ãããã®ãããããŒã¿ãèç©ããåºç€ãå¿ èŠã«ãªããããã€ãã®ã¯ã©ãŠãç°å¢ããã¹ãçã«å©çšããããšã«ãªããŸãããïŒå°ŸåŽ æ°ïŒã
ãã 1 ã€ã¯ãåæã®ã¹ããŒãæããªãã£ãããšã ãšãããŸããããŒã¿ã®åéãèç©ã®ããã«ã¯ã©ãŠãåºç€ã®æŽ»çšãã¯ãããŠãããã®ã®ãã¯ã©ãŠã管çãããŒãããŒã«ä»»ããŠããããšããããåæçµæãåŸãŠç€Ÿå ã§çãããŸã§ã«æéãããã£ãŠããã®ã§ãã
ãåæã¯å©çšéšéãäžå¿ã«è¡ã£ãŠããŸããããIT éçšã®ç¥èŠãããŠããŠããªãããšããããã¯ã©ãŠãäžã®åæç°å¢ãã©ãæ§ç¯ããŠããã°ãããã詊è¡é¯èª€ã®æ®µéã§ãããã¯ã©ãŠãç°å¢ã§ã¯ããŒã¿èç©çšã® IaaS ãããã°ããŒã¿åæã®ããã® PaaS ãªã©è€æ°ã®ãµãŒãã¹ã䜵çšããªãããã¹ããè¡ã£ãŠããŸããããäœæ¥ã®å€ããããŒãããŒã«äŸåããããšããããæ¬²ããçµæãããã«åŸãããªããšããç¶æ ã ã£ãã®ã§ããïŒå°ŸåŽ æ°ïŒã
ããã«è²»çšå¯Ÿå¹æãæªãã£ãããšã課é¡ã§ãå€éšå§èšã§ãã£ããããç°¡åãªããŒã¿åæã§ãè²»çšãããã£ãŠããŸããããŸããåæåºç€ã®èšèšãæ§ç¯ãèšç»çã«è¡ãããšãªã宿œããŠãããããããŸããŸãªã¯ã©ãŠãç°å¢ãåæç°å¢ãç«ã¡äžãã£ãŠããç¶æ ã§ããã
ããªã¢ã«ã¯ãŒã«ãããŒã¿ã®åæãšãããžã¿ã«ããŒã±ãã£ã³ã°åãã®åæã§ã¯ãå¿ èŠãªããŒã¿ãåææ¹æ³ãç°ãªããŸããããããã«åºç€ãæ§ç¯ããããšã§ãè²»çšå¯Ÿå¹æãæªããªãã瀟å ã§ã®ã¬ããã³ã¹ãå©ããã«ãããªãã¯ãããŠããŸãããïŒå°ŸåŽ æ°ïŒã
ãããã課é¡ãè§£æ¶ããããã«ç°èŸºäžè±è£œè¬ãåãçµãã ã®ããããŸããŸãªããŒã¿ãäžå çã«åãæ±ããããŒã¿åæåºç€ã®æ§ç¯ã§ããICTãããžã¡ã³ã宀ãäžå¿ãšãªã£ãŠãApache Hadoop/Spark ãããŒã¹ãšããåºç€ã®èšèšãè¡ãã3 ã€ã®ã¯ã©ãŠããµãŒãã¹ãæ¯èŒæ€èšããæçµçã«ããŒã¿ã®åéããèç©ãåæãŸã§ã1ã€ã®ãã©ãããã©ãŒã ã§å®æœã§ãããAzure Databricksããæ¡çšããŸããã
Azure Databricks ãæã€æ¡åŒµæ§ãšæè»æ§ã®é«ããæ¡çšã®æ±ºãæ
Azure Databricks ã¯ãApache Spark ãããŒã¹ã«ããããŒã¿ã¬ã€ã¯ãšããŒã¿åæã®ããã®ãã©ãããã©ãŒã ã§ããåºç€ã ãã§ãªããTensorFlow ã PyTorchãscikit-learn ãªã©ã®ããŒã¿ãµã€ãšã³ã¹åãã®ãã¬ãŒã ã¯ãŒã¯ãã©ã€ãã©ãªãã»ããã§æäŸããPythonãScalaãRãJavaãSQL ãšãã£ãåçš®èšèªããµããŒããããŒã¹ãšãªããã©ãããã©ãŒã 㯠Databricks 瀟ãæäŸããŠããŸãã
Hadoop/Spark ã®ãã¹ãã£ã³ã°ãµãŒãã¹ããDatabricks ããŒã¹ã®ã¯ã©ãŠããµãŒãã¹ã¯ Microsoft Azure 以å€ã§ãæäŸãããŠããŸãããå°ŸåŽ æ°ã«ãããš Azure Databricks ã¯ãããããšäžç·ãç»ãããã®ã ã£ããšæ¯ãè¿ããŸããæ¡çšã®æ±ºãæã«ãªã£ãç¹ã¯å€§ãã 3 ã€ããã1 ã€ãã¯ãå¿ èŠãªãšãã«å¿ èŠãªã¶ãã ãå©çšã§ãããšããæ¡åŒµæ§ã ã£ããšãããŸãã
ããªãŒãã¹ã±ãŒã«ã䜿ãã°å¿ èŠãªãšãã«ãªãœãŒã¹ãæ¡åŒµããããšãã§ããŸããããªãŒãã¿ãŒãããŒããå©çšããããšã§ãå¿ èŠããªããªã£ããšãã«ãªãœãŒã¹ãæè»ã«åæ¢ã§ããŸããããã©ãŒãã³ã¹ãã§ãªãå Žåãç¬éçã«ãªãœãŒã¹ãå¢ãããŸããããããæ¡åŒµæ§ã®é«ãã¯ãä»ã®ã¯ã©ãŠããã©ãããã©ãŒã ã«ã¯ãªããã®ã ãšæããŸãããïŒå°ŸåŽ æ°ïŒã
2 ã€ãã¯ãæäŸãããåºç€ã®éžæè¢ãå€ãããšã§ãã
ãããŸããŸãªã¯ã©ã¹ã¿ãŒã®ã¿ã€ããæè»ã«éžæã§ããŸãããå®è¡ããããŒãããšã«ã¯ã©ã¹ã¿ãŒã䜿ãåããããšãã§ããŸããããŒã¿åæã§ã¯ãã¢ãã©ã€ã¢ã³ã¹ãå°å ¥ããŠãäžå®ã®æ§èœãæ ä¿ãããšããã¢ãããŒããäž»æµã ã£ããšæããŸãããããã ãšæè»æ§ãæãªãããŸããäžæ¹ãèªåãã¡ã§ã¯ã©ãŠããµãŒãã¹ãçµã¿åãããŠäœ¿ããããåºç€ãäœãããšãã§ããã®ã§ããããã®å Žåã¯ã³ã¹ãå¹çãæªããªããŸããAzure Databricks ã¯åºç€ã®æè»æ§ãšããç¹ã§ãå§åçã«å®æåºŠãé«ããã®ã§ãããïŒå°ŸåŽ æ°ïŒã
3 ã€ãã¯ãããŸããŸãªèšèªã«å¯Ÿå¿ããŠãããããŸããŸãªåæããŒãºã«å¯Ÿå¿ã§ããããšã§ãã
ãPython ã R ã SQL ããããŸãããShell Script ã§ã®æäœãŸã§å¯èœã§ãããŠãŒã¶ãŒãéžã°ããã©ã®ãããªåæã«ã察å¿ã§ããã®ã§ãä»åŸå¹ åºãçšéã§æŽ»çšããŠãããŸããåºç€ãæ§ç¯ããããã§ã®ã³ã¢ãšãªããµãŒãã¹ã§ããããšã«å€§ããªé åãæããŸãããïŒå°ŸåŽ æ°ïŒã
ãããã Azure Databricks ãæã€å æ¬æ§ãæ¡åŒµæ§ãæè»æ§ãšãã£ãç¹åŸŽã¯ãããŒã¿éãã¹ããŒããã³ã¹ããšãã課é¡ã«å¯ŸããŠãããããŠæå¹ã ã£ããšå°ŸåŽ æ°ã¯åŒ·èª¿ããŸãã
Azure ã®ã¯ã©ãŠããµãŒãã¹ã掻çšããDX ãããã«å é
ãµãŒãã¹ã®æ§ç¯ã¯ 2019 幎 4 æããã¹ã¿ãŒããããŒã¿ãåºç€ãšããŠã®æ€èšŒãè¡ããªããã2019 幎æ«ãŸã§ã«ããŸããŸãªããŒã¿ãåæã§ããåºç€ãšããŠæ§ç¯ããŸãããåœåã¯ããªã¢ã«ã¯ãŒã«ãããŒã¿ã®åæåºç€ãšããŠæ§ç¯ããŸããããããŸããŸãªçšéã§æŽ»çšã§ããããšãèŠèŸŒãããããå¶æ¥ãããžã¿ã«ããŒã±ãã£ã³ã°åãã®ããŒã¿åæåºç€ã Azure Databricks ãžãšçµ±åãããšãããŸããå°æ æ°ã¯ãããŒã¿åºç€æ§ç¯ã®æçŸ©ã«ã€ããŠããã話ããŸããã
ããªã¢ã«ã¯ãŒã«ãããŒã¿ãåæããããšã§ãæ£è ãã©ã®ããã«èããæããè¡åããŠããã®ããšãã£ããã€ã·ã§ã³ããžã£ãŒããŒãææ¡ã§ããããã«ãªããŸããAzure Databricks ã«ããããŒã¿åæåºç€ã¯ãããŸãåœç€Ÿã® DX ã«åããéèŠãª IT ã€ã³ãã©ã® 1 ã€ã«äœçœ®ã¥ããããŠããŸããïŒå°æ æ°ïŒã
å®éãç°èŸºäžè±è£œè¬ã§ã¯ãAzure Databricks ãããŒã¿åæåºç€ã®äžæ žã«æ®ããªããããã®åšèŸºã§å¿ èŠã«ãªãããŸããŸãªæ¥åããµãŒãã¹ã Azure äžãžãšç§»è¡ãã¯ãããŠããŸãã瀟å å€ã§åéãããããŸããŸãªããŒã¿ããAzure DataFactoryããçµç±ã㊠Azure Databricks ã«èç©ãããŠããŸãããŸããåºç€ã«èç©ãããããŒã¿ã¯å¿ èŠã«å¿ã㊠SQL Database ã«åºåãæ ŒçŽããã瀟å ãŠãŒã¶ãŒã Power BI ã䜿ã£ãŠãããŸããŸãªåæã宿œã§ããããã«ãªããŸããã
ããã«ããã¹ã¯ãããç°å¢åãã« Windows Virtual Desktop ããæ§æç®¡çåºç€ã« Azure DevOps ãªã©ãAzure ã®ç©æ¥µçãªæŽ»çšãæ€èšããŠãããšãããŸãã
ãããŒã¿ã«åºã¥ããŠã¹ããŒãã£ãŒã«æææ±ºå®ãããããªããŒã¿ããªãã³çµå¶ãç®æããŠããããšããŠããŸããDXãæšé²ããããã®åºç€ãšããŠã¯ãAzure CycleCloud ã䜿ã£ãŠ HPC ç°å¢ãæ§ç¯ããåµè¬ã«çããåãçµã¿ããç€Ÿå ææžã AI 掻çšããŠæ€çŽ¢ããããããåãçµã¿ãªã©ãé²ããŠããŸãããŸããå·¥å Žã§ã®æ€æ»ããŒã¿ã掻çšãããªã©ããµãã©ã€ãã§ãŒã³æ¹é©ã«ãã€ãªããŠããããšããŠããŸããïŒå°æ æ°ïŒã
ãã®ããã«ãAzure Databricks ãã¯ãããšãã Azure ã¯ã©ãŠãç°å¢ã¯ãç°èŸºäžè±è£œè¬ã«ããã DX æšé²ã®ã³ã¢ãšããŠæ¬ ãããªããã®ã«ãªããŸããããœãªã¥ãŒã·ã§ã³ãæäŸãããã€ã¯ããœããã«å¯ŸããŠå°ŸåŽ æ°ã¯ããææ¡ããåºç€ã®æ§ç¯ãŸã§çæ¯ã«åãåã£ãŠããã ããŸããããããããæ°ãããµãŒãã¹ãæäŸããŠããããã§æ¬ ãããªãããŒãããŒã§ããããšé«ãè©äŸ¡ããŸãã
å°æ æ°ããããŒã¿ãããžã¡ã³ãã¯ã©ãŠããæŽ»çšããªããããŸããŸãªåãçµã¿ãé²ããåºç€ã掻çšããããã®äººæã®è²æã«ãåããããŠãããŸãããã®éã¯ãä»åŸã®ãã€ã¯ããœããã®ãµããŒãã«æåŸ ããŠããŸããããšãç°èŸºäžè±è£œè¬ã®åãçµã¿ã«ããã Azure ã«å¯ŸããæåŸ ãèªã£ãŠãããŸããã
[PR]æäŸïŒæ¥æ¬ãã€ã¯ããœãã

