{"id":378077,"date":"2020-09-29T09:00:29","date_gmt":"2020-09-29T08:00:29","guid":{"rendered":"https:\/\/pulse.microsoft.com\/?p=378077"},"modified":"2020-12-28T15:34:15","modified_gmt":"2020-12-28T14:34:15","slug":"fa1-recap-of-cloud-stories-from-norway-episode-2-azure-iot-and-machine-learning-in-oss-norge","status":"publish","type":"post","link":"https:\/\/pulse.microsoft.com\/nb-no\/work-productivity-nb-no\/na\/fa1-recap-of-cloud-stories-from-norway-episode-2-azure-iot-and-machine-learning-in-oss-norge\/","title":{"rendered":"Recap of Cloud Stories from Norway, Episode 2: Azure IoT and Machine Learning in Oss Norge"},"content":{"rendered":"<p><span data-contrast=\"auto\">The second episode of the<\/span><span data-contrast=\"auto\">\u00a0\u201c<\/span><span data-contrast=\"auto\">Cloud stories from Norway\u201d\u00a0<\/span><span data-contrast=\"auto\">video<\/span><span data-contrast=\"auto\">show<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">is ready for watching! In this<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">40-minutes<\/span><span data-contrast=\"auto\">\u00a0long show<\/span><span data-contrast=\"auto\">\u00a0we feature Azure cloud best practices, patterns, tips<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">&amp;<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">tricks used in production in the products and services of the well-known Norwegian companies.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><strong>Yo can <a href=\"https:\/\/info.microsoft.com\/WE-AzureAnlyt-WBNR-FY21-09Sep-15-AzureIoTandMachineLearninginOssNorge-SRDEM40451_LP02OnDemandRegistration-ForminBody.html\">watch this episode on-demand<\/a>. Just fill in the form and you will immediately receive a link to the video in your email.<\/strong><\/p>\n<p><span data-contrast=\"auto\">For this episode,<\/span><span data-contrast=\"auto\">\u00a0we\u00a0<\/span><span data-contrast=\"auto\">invited\u00a0<\/span><span data-contrast=\"auto\">Bent\u00a0<\/span><span data-contrast=\"auto\">Eikmo<\/span><span data-contrast=\"auto\">\u00a0(<\/span><span data-contrast=\"auto\">CTO at Oss Norge AS<\/span><span data-contrast=\"auto\">)<\/span><span data-contrast=\"auto\">\u00a0and\u00a0<\/span><span data-contrast=\"auto\">Sebastien\u00a0<\/span><span data-contrast=\"auto\">Didierjean<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">(<\/span><span data-contrast=\"auto\">Data Scientist at Oss Norge AS<\/span><span data-contrast=\"auto\">) to present\u00a0<\/span><span data-contrast=\"auto\">about Azure\u00a0<\/span><span data-contrast=\"auto\">architecture decisions<\/span><span data-contrast=\"auto\">\u00a0they\u00a0<\/span><span data-contrast=\"auto\">made and successfully implemented<\/span><span data-contrast=\"auto\">\u00a0to build\u00a0<\/span><span data-contrast=\"auto\">a hardware + software + cloud solution for helping people and companies to get useful information about the power consumption<\/span><span data-contrast=\"auto\">\u00a0in their apartments and offices<\/span><span data-contrast=\"auto\">.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\"> You are welcome to read about how Oss Norge uses Azure cloud for creating a greener energy market in their <a href=\"https:\/\/pulse.microsoft.com\/en\/sustainable-futures-en\/na\/fa2-oss-norge-using-cloud-technology-to-create-a-greener-energy-market\/\">Customer Story on our blog<\/a>.<\/span><\/p>\n<p><span data-contrast=\"auto\">In<\/span><span data-contrast=\"auto\">\u00a0the<\/span><span data-contrast=\"auto\">ir\u00a0<\/span><span data-contrast=\"auto\">short, very focused technical sessions\u00a0<\/span><span data-contrast=\"auto\">Bent and Sebastien presented about<\/span><span data-contrast=\"auto\">:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">Technical journey<\/span><span data-contrast=\"auto\">\u00a0on building IoT device and sending data to the cloud using Azure IoT Hub<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">Machine Learning infrastructure\u00a0<\/span><span data-contrast=\"auto\">used\u00a0<\/span><span data-contrast=\"auto\">in production<\/span><span data-contrast=\"auto\">\u00a0at scale which includes<\/span><span data-contrast=\"auto\">\u00a0Azure Data Explorer and Databricks<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" aria-setsize=\"-1\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Many more cloud tips &amp; tricks to skill you up on Azure!<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<\/ul>\n<p><span data-contrast=\"auto\">During<\/span><span data-contrast=\"auto\">\u00a0the streaming session we received lots of technical questions from our attendees. Here<\/span><span data-contrast=\"auto\">\u00a0we publish the answers\u00a0<\/span><span data-contrast=\"auto\">to<\/span><span data-contrast=\"auto\">\u00a0some of them:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Did you reduce the amount of data or only reduced the bandwidth used?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">We didn&#8217;t reduce the amount of data, but the amount of overhead by packing more data into a single IoT hub frame.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Is ADX\u00a0<\/span><span data-contrast=\"auto\">like<\/span><span data-contrast=\"auto\">\u00a0Google\u00a0<\/span><span data-contrast=\"auto\">BigQuery<\/span><span data-contrast=\"auto\">?<\/span><br \/>\n<span data-contrast=\"auto\">A:<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">Yes, it is<\/span><span data-contrast=\"auto\">.<\/span><span data-contrast=\"auto\">\u00a0I<\/span><span data-contrast=\"auto\">t is more ergonomic and powerful (in our case!)<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">I<\/span><span data-contrast=\"auto\">s Azure Data Explorer easy to configure to ingest data from\u00a0<\/span><span data-contrast=\"auto\">non-Azure<\/span><span data-contrast=\"auto\">\u00a0sources,\u00a0<\/span><span data-contrast=\"auto\">i.e<\/span><span data-contrast=\"auto\">\u00a0Google Big Table or Big Query? Do you have any experience with that?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">I have limited experience\u00a0<\/span><span data-contrast=\"auto\">of<\/span><span data-contrast=\"auto\">\u00a0such compatibility.<\/span><span data-contrast=\"auto\">\u00a0W<\/span><span data-contrast=\"auto\">e use ADX for both storage and data wrangling with ingestion from IOT hub.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">What kind of resolution are you working with on the data?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">We are working at\u00a0seconds\u00a0level.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Which programming language is being shown here?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">It is mainly KQL and python (in the sandbox)<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Why not make all the data processing in Databricks rather than using an additional framework with ADX to do the initial predictions?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">Since we use ADX for the storage, it is easier to perform the first step of data wrangling\/ML in ADX directly.\u00a0<\/span><span data-contrast=\"auto\">W<\/span><span data-contrast=\"auto\">e only use a few hours of Databricks clusters per day.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0\u00a0<\/span><span data-contrast=\"auto\">Why are you doing some machine learning in Spark rather than using ADX for everything? To me this sounds like a complication.<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">ADX is limited in term of ML<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">and its DevOps capability is not enough to\u00a0<\/span><span data-contrast=\"auto\">cover\u00a0<\/span><span data-contrast=\"auto\">our needs.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Do you use ADX also for data storage, and how do you handle data retention?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">Yes,<\/span><span data-contrast=\"auto\">\u00a0we do. We keep the last 31 days in hot (SSD) storage.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">If\u00a0<\/span><span data-contrast=\"auto\">I<\/span><span data-contrast=\"auto\">\u00a0remember correctly, you also have\u00a0<\/span><span data-contrast=\"auto\">an<\/span><span data-contrast=\"auto\">\u00a0API that could be consumed? I assume working with electricity data, there is a lot of volume. If so, did the volume of data create any challenges in making an API?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">The raw data is not presented to the API. Only aggregated data is presented at the moment.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">C<\/span><span data-contrast=\"auto\">ould you tell what are in your experience the main advantages of doing the\u00a0<\/span><span data-contrast=\"auto\">preprocessing<\/span><span data-contrast=\"auto\">\u00a0in ADX vs\u00a0<\/span><span data-contrast=\"auto\">Spark?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">For a little\u00a0<\/span><span data-contrast=\"auto\">startup<\/span><span data-contrast=\"auto\">, ADX offers out of the box tools to perform advanced data wrangling (less coding) and the development is faster since the queries are developed directly where the data is stored.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">How much did you reduce in cost by optimizing\u00a0<\/span><span data-contrast=\"auto\">in total<\/span><span data-contrast=\"auto\">\u00a0(Azure, Code and I<\/span><span data-contrast=\"auto\">o<\/span><span data-contrast=\"auto\">T)<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">It<\/span><span data-contrast=\"auto\">\u00a0is hard to say because we are not completely done optimizing, but I would say\u00a0<\/span><span data-contrast=\"auto\">about 70%<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">How do you store the archive data in Azure?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">We\u00a0<\/span><span data-contrast=\"auto\">are<\/span><span data-contrast=\"auto\">\u00a0not moving data to additional archive storage\u00a0<\/span><span data-contrast=\"auto\">at the moment<\/span><span data-contrast=\"auto\">.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Do you have a solution for including the different grid\u00a0<\/span><span data-contrast=\"auto\">tarifs<\/span><span data-contrast=\"auto\">\u00a0(<\/span><span data-contrast=\"auto\">nettleie<\/span><span data-contrast=\"auto\">) when presenting the costs\/price of the consumed electricity to each user?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">We\u00a0<\/span><span data-contrast=\"auto\">consider<\/span><span data-contrast=\"auto\">\u00a0the zones where the customer lives.\u00a0<\/span><span data-contrast=\"auto\">Considering<\/span><span data-contrast=\"auto\">\u00a0the exact grid\u00a0<\/span><span data-contrast=\"auto\">tariffs<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">is<\/span><span data-contrast=\"auto\">\u00a0under development.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">For how long do you keep the data? Is it deleted afterwards or archived somewhere else?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">As long as the user is a customer, we keep the data in our system (ADX)!<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Could a machine learning model trained in\u00a0<\/span><span data-contrast=\"auto\">AzureML<\/span><span data-contrast=\"auto\">\u00a0be used directly in ADX to achieve the same capability as\u00a0SparkML?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">I am a bit unsure about the level of performance (it depends on the cluster configs\/costs<\/span><span data-contrast=\"auto\">)<\/span><span data-contrast=\"auto\">\u00a0but a model trained with\u00a0<\/span><span data-contrast=\"auto\">AzureML<\/span><span data-contrast=\"auto\">\u00a0should work with the Python sandbox. Let me know if you manage to couple ADX and\u00a0AzureML!<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Is data is stored as JSON?<\/span><br \/>\n<span data-contrast=\"auto\">A: I<\/span><span data-contrast=\"auto\">t is ADX that deals with it.\u00a0<\/span><span data-contrast=\"auto\">I<\/span><span data-contrast=\"auto\">t looks JSON like.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Do you push code to the devices as well with\u00a0<\/span><span data-contrast=\"auto\">I<\/span><span data-contrast=\"auto\">o<\/span><span data-contrast=\"auto\">T<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">H<\/span><span data-contrast=\"auto\">ub?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">Yes, we are using\u00a0<\/span><span data-contrast=\"auto\">IoT<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">H<\/span><span data-contrast=\"auto\">ub to control the update process.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Have you considered the life of Data? How long the data is planned to be stored?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">As long as<\/span><span data-contrast=\"auto\">\u00a0a\u00a0<\/span><span data-contrast=\"auto\">user<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">remains<\/span><span data-contrast=\"auto\">\u00a0a customer, we do not have any limit on storage based on how old the data is.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">I understand that\u00a0<\/span><span data-contrast=\"auto\">customers&#8217;<\/span><span data-contrast=\"auto\">\u00a0anticipation and awareness might be one the goals but what is the future for Oss Norge and its product?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">As\u00a0<\/span><span data-contrast=\"auto\">of<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">today,<\/span><span data-contrast=\"auto\">\u00a0Oss Norge addresses both private and business markets with products oriented towards energy prediction and awareness. We are working on improving the present developments\u00a0<\/span><span data-contrast=\"auto\">and<\/span><span data-contrast=\"auto\">\u00a0on the optimisation of energy savings in the business segment with highly competitive solutions.\u00a0\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Could you provide some thoughts on what types of workloads you would use ADX and Databricks for going forward, in both the data engineering and machine learning areas? ADX seems to be very effective for less complex stuff (simple data transformation, basic built-in ML?), whereas Databricks provides full flexibility (and, perhaps, added scalability). Do you also see it this way, and if so, where would you say that you hit that &laquo;complexity threshold&raquo; on data engineering and ML complexity where Databricks becomes more effective?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">So far ADX is scaling very smoothly so we do not think about Databricks overtaking part of the ETL. The presence of the python sandbox in ADX makes it flexible enough to cope with our future developments.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">How did Azure help you in ensuring Data quality?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">I would say that it is one of our first\u00a0<\/span><span data-contrast=\"auto\">mission<\/span><span data-contrast=\"auto\">\u00a0as Data Scientist to ensure optimal Data Quality. ADX with the built-in visualisation tool helps in productivity for all the tasks related to Data Quality.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"16\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Q:\u00a0<\/span><span data-contrast=\"auto\">Do you delete the data after some time or archive it in some way (e.g. so that you can perform long term analysis later)?<\/span><br \/>\n<span data-contrast=\"auto\">A:\u00a0<\/span><span data-contrast=\"auto\">All data is stored within ADX at the moment for later analysis.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<\/ul>\n<p><span data-contrast=\"auto\">How to contact\u00a0<\/span><span data-contrast=\"auto\">Bent\u00a0Eikmo<\/span><span data-contrast=\"auto\">:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"11\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><a href=\"https:\/\/www.linkedin.com\/in\/benteikmo\/\"><span data-contrast=\"none\">https:\/\/www.linkedin.com\/in\/benteikmo\/<\/span><\/a><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<\/ul>\n<p><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><span data-contrast=\"auto\">How to contact\u00a0<\/span><span data-contrast=\"auto\">Sebastien\u00a0Didierjean<\/span><span data-contrast=\"auto\">:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"11\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><a href=\"https:\/\/www.linkedin.com\/in\/sebastien-didierjean-9000b33\/\"><span data-contrast=\"none\">https:\/\/www.linkedin.com\/in\/sebastien-didierjean-9000b33\/<\/span><\/a><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<\/ul>\n<h2>All episodes of the <span data-contrast=\"auto\">\u201cCloud stories from Norway\u201d<\/span><\/h2>\n<ul>\n<li><a href=\"https:\/\/aka.ms\/cloudstories-1\">Episode #1: Vipps<\/a><\/li>\n<li><a href=\"https:\/\/aka.ms\/cloudstories-2\">Episode #2: Oss Norge<\/a><\/li>\n<li><a href=\"https:\/\/aka.ms\/cloudstories-3\">Episode #3: NRK<\/a><\/li>\n<li><a href=\"https:\/\/aka.ms\/cloudstories-4\">Episode #4: Novanet &amp; Capgemini<\/a><\/li>\n<li><a href=\"https:\/\/aka.ms\/cloudstories-5\">Episode #5: Visma<\/a><\/li>\n<li><a href=\"https:\/\/aka.ms\/cloudstories-6\">Episode #6: TINE &amp; Crayon<\/a><\/li>\n<\/ul>\n<h2><span data-contrast=\"auto\">N<\/span><span data-contrast=\"auto\">ext events from Microsoft Norway?<\/span><\/h2>\n<p><span data-contrast=\"auto\">How to follow all Microsoft Norway\u2019s and local tech communities\u2019 events about Azure cloud for the developers &#8211; conferences, seminars, workshops, training, webinars, etc.? Just follow our technical twitter\u00a0<\/span><a href=\"https:\/\/nam06.safelinks.protection.outlook.com\/?url=https%3A%2F%2Ftwitter.com%2FMSDevNo&amp;data=02%7C01%7CMaxim.Salnikov%40microsoft.com%7C5c983cc8a9654fa0ed6c08d81e89499f%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637292922276424997&amp;sdata=7LQXrXxSOv6n%2BFdF1UobYDXlBVa3lXgYm6%2BEDygbkm8%3D&amp;reserved=0\"><span data-contrast=\"none\">https:\/\/twitter.com\/MSDevNo<\/span><\/a><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\"> or <a href=\"https:\/\/twitter.com\/search?q=%23MSDevNo\">hashtag<\/a> #MSDevNo<\/span><\/p>\n<p><span data-contrast=\"auto\">To stay connected:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"2\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">Don\u2019t forget to add \u201cAzure\u201d to your skills on the LinkedIn\u00a0<\/span><span data-contrast=\"auto\">profile<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"2\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">Nominate yourself or your colleagues for the Azure Heroes program badge:\u00a0<\/span><a href=\"https:\/\/nam06.safelinks.protection.outlook.com\/?url=https%3A%2F%2Fwww.microsoft.com%2Fskills%2Fazureheroes&amp;data=02%7C01%7CMaxim.Salnikov%40microsoft.com%7C5c983cc8a9654fa0ed6c08d81e89499f%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637292922276424997&amp;sdata=BqIT1ixKOXCyhuAtw%2FOANuCPgUe%2B%2FXkmaCRC%2BxIj2ZU%3D&amp;reserved=0\"><span data-contrast=\"none\">https:\/\/www.microsoft.com\/skills\/azureheroes<\/span><\/a><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:240}\">\u00a0<\/span><\/li>\n<\/ul>\n<p><span data-contrast=\"auto\">Feel free to send your questions about the Azure cloud technology and educational events here:\u00a0<\/span><a href=\"mailto:maxim.salnikov@microsoft.com\"><span data-contrast=\"none\">maxim.salnikov@microsoft.com<\/span><\/a><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Maxim Salnikov<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\"><br \/>\n<\/span><span data-contrast=\"auto\">Developer\u00a0<\/span><span data-contrast=\"auto\">Engagement<\/span><span data-contrast=\"auto\">\u00a0Lead at Microsoft Norway<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The second episode of the\u00a0\u201cCloud stories from Norway\u201d\u00a0videoshow\u00a0is ready for watching! In this\u00a040-minutes\u00a0long show\u00a0we feature Azure cloud best practices, patterns, tips\u00a0&amp;\u00a0tricks used in production in the products and services of the well-known Norwegian companies.\u00a0 Yo can watch this episode on-demand. Just fill in the form and you will immediately receive a link to the video [&hellip;]<\/p>\n","protected":false},"author":342,"featured_media":378140,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"class_list":["post-378077","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","specials-work-productivity-nb-no","stories-managing-your-data-nb-no","stories-hvordan-kan-jeg-administrere-dataene-mine","businessPriorities-data-ai-nb-no"],"_links":{"self":[{"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/posts\/378077"}],"collection":[{"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/users\/342"}],"replies":[{"embeddable":true,"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/comments?post=378077"}],"version-history":[{"count":12,"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/posts\/378077\/revisions"}],"predecessor-version":[{"id":422092,"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/posts\/378077\/revisions\/422092"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/media\/378140"}],"wp:attachment":[{"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/media?parent=378077"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pulse.microsoft.com\/nb-no\/wp-json\/wp\/v2\/categories?post=378077"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}