Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • Learning
  • About
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • Learning
  • About
Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • Learning
  • About
Data | Points | Binary
  • Data
  • Machine Learning

Microsoft Offers Azure ML Data Import CLI, SDK For Snowflake, Other Databases

  • June 9, 2023
  • liwaiwai.com

The new integration, which is in public preview, is designed to bring data into Azure’s ML service from data repositories outside the Azure platform.

Microsoft has come out with a new integration that will allow Snowflake and AWS S3 users to bring their data to its Azure Machine Learning (ML) service for AI model training and development.


Partner with liwaiwai.com
for your next big idea.
Let us know here.



From our partners:

CITI.IO :: Business. Institutions. Society. Global Political Economy.
CYBERPOGO.COM :: For the Arts, Sciences, and Technology.
DADAHACKS.COM :: Parenting For The Rest Of Us.
ZEDISTA.COM :: Entertainment. Sports. Culture. Escape.
TAKUMAKU.COM :: For The Hearth And Home.
ASTER.CLOUD :: From The Cloud And Beyond.
LIWAIWAI.COM :: Intelligence, Inside and Outside.
GLOBALCLOUDPLATFORMS.COM :: For The World's Computing Needs.
FIREGULAMAN.COM :: For The Fire In The Belly Of The Coder.
ASTERCASTER.COM :: Supra Astra. Beyond The Stars.
BARTDAY.COM :: Prosperity For Everyone.

The integration is being done via a new data import command line interface (CLI) and software development kit (SDK) that allows data to be brought in from data repositories outside the platform, Amar Badal, senior manager for Azure Machine Learning, wrote in a blog post.

A CLI is a text-based user interface that can be used to query files, run programs and interact with a computer instance or server.

The CLI and SDK kit can be used, for example, to create a connection between the Snowflake instance and Azure ML, Badal wrote, adding that a data scientist could query the connection to pull required data inside the machine learning service.“If the scenario demands to import data on a schedule, one can use popular cron or recurrence patterns to define the frequency of import,” Badal wrote.

Crons are utility programs that allows users to schedule repetitive tasks at a specified time by entering a set of commands in a CLI.

New CLI and SDK to help data scientists

The new integration, according to dbInsights’ principal analyst Tony Baer, is aimed at helping data scientists improve productivity and shorten their product development or model training lifecycles.

Microsoft highlighted that the new features will eliminate the need for data scientists to communicate regularly with data engineering teams.

Read More  Do More With Less Using New Azure HX And HBv4 Virtual Machines For HPC

“Each import, whether scheduled or not, creates a unique version of the dataset which is in turn used in training jobs, giving data scientists the required traceability in scenarios that need retraining or for model audits,” Badal wrote.

Doug Henschen, principal analyst at Constellation Research, agreed that the new tools will be helpful for data scientists in particular, noting, “Any company running Snowflake on Azure will gain another, well-integrated option for doing data science with the data managed within Snowflake.”

Azure ML strategy different from Snowflake’s Snowpark

Microsoft’s integration takes a different approach to machine learning compared to Snowflake, analysts said. Snowflake offers Snowpark, designed to allow developers to apply their preferred tools in a serverless manner to Snowflake’s virtual warehouse compute engine. 

“Azure ML did not go the Snowpark route. Instead, Microsoft is saying go ahead and import data out of Snowflake and process it in our environment, rather than implementing Azure ML functions as user defined functions (UDFs) in Snowpark. That’s not without precedent, as Snowflake partner H2O has taken a similar tack,” Baer said.

Azure’s tactic to not follow the Snowpark route could be largely attributed to Snowflake’s strategy, according to Henschen.

“Snowflake created Snowpark to facilitate data science work, but it has largely left it to partners to provide the software and services needed to execute. Snowflake customers need partners like Microsoft to make the most of the data managed on the Snowflake platform,” Henschen said.

Alongside the new CLI and SDK integration, which is still in public preview, the company has introduced a new lifecycle management feature on Azure ML’s managed datastore, dubbed “Hosted on Behalf of” or HOBO datastore.

Read More  All Data Cloud, All The Time: Recapping The Google Data Cloud & AI Summit

The offering, according to Badal, gives users the right to manage imported data from repositories such as Snowflake and AWS S3 via the new CLI and SDK integration.

“A policy to automatically delete an imported data asset if unused for 30 days by any job is set on every imported data asset in the AzureML managed datastore. All that one has to do is to set ‘azureml://datastores/workspacemanagedstore’ as the path when defining their import and rest will be handled by AzureML,” Badal wrote, adding that the offering comes with an autodelete feature for any imported data set that remains unused for over 30 days.

This feature, according to Henschen, is crucial in the development and ongoing refresh and replacement of machine learning models.

The lifecycle management feature too is in public preview, Microsoft said.

By: Anirban Ghoshal
Originally published at InfoWorld

Source: cyberpogo.com


For enquiries, product placements, sponsorships, and collaborations, connect with us at [email protected]. We'd love to hear from you!

Our humans need coffee too! Your support is highly appreciated, thank you!

liwaiwai.com

Related Topics
  • AWS S3
  • Azure
  • Databases
  • Machine Learning
  • Microsoft
  • Microsoft Azure
  • ML
  • Snowflake
You May Also Like
View Post
  • Artificial Intelligence
  • Data

Applying Generative AI To Product Design With BigQuery DataFrames

  • September 21, 2023
Microsoft and Adobe
View Post
  • Artificial Intelligence
  • Machine Learning
  • Platforms

Microsoft And Adobe Partner To Deliver Cost Savings And Business Benefits

  • September 21, 2023
Data
View Post
  • Artificial Intelligence
  • Machine Learning
  • Technology

UK Space Sector Has Sights Set On Artificial Intelligence And Machine Learning Professionals

  • September 15, 2023
View Post
  • Data
  • Platforms

Microsoft And Oracle Expand Partnership To Deliver Oracle Database Services On Oracle Cloud Infrastructure In Microsoft Azure

  • September 14, 2023
Data
View Post
  • Artificial Intelligence
  • Engineering
  • Machine Learning
  • Platforms

How Verve Group Transforms Customer Experiences With Google Cloud Vertex AI

  • September 11, 2023
View Post
  • Artificial Intelligence
  • Data
  • Platforms
  • Software Engineering
  • Technology

Combining AI With A Trusted Data Approach On IBM Power To Fuel Business Outcomes

  • September 11, 2023
View Post
  • Artificial Intelligence
  • Machine Learning
  • Technology

ListenField Enables Farmers To Harvest The Benefits Of AI And Machine Learning

  • September 7, 2023
View Post
  • Data
  • Learning

Resources to Take Your Charts From Bland to Beautiful

  • September 7, 2023
A Field Guide To A.I.
Navigate the complexities of Artificial Intelligence and unlock new perspectives in this must-have guide.
Now available in print and ebook.

charity-water



Stay Connected!
LATEST
  • 1
    Oracle CloudWorld 2023: 6 Key Takeaways From The Big Annual Event
    • September 25, 2023
  • 2
    3 Ways AI Can Help Communities Adapt To Climate Change In Africa
    • September 25, 2023
  • Robotic Hand | Lights 3
    Nvidia H100 Tensor Core GPUs Come To Oracle Cloud
    • September 24, 2023
  • 4
    AI-Driven Tool Makes It Easy To Personalize 3D-Printable Models
    • September 22, 2023
  • 5
    Applying Generative AI To Product Design With BigQuery DataFrames
    • September 21, 2023
  • 6
    Combining AI With A Trusted Data Approach On IBM Power To Fuel Business Outcomes
    • September 21, 2023
  • Microsoft and Adobe 7
    Microsoft And Adobe Partner To Deliver Cost Savings And Business Benefits
    • September 21, 2023
  • Coffee | Laptop | Notebook | Work 8
    First HP Work Relationship Index Shows Majority of People Worldwide Have an Unhealthy Relationship with Work
    • September 20, 2023
  • 9
    Huawei Connect 2023: Accelerating Intelligence For Shared Success
    • September 20, 2023
  • 10
    Document AI Workbench Is Now Powered By Generative AI To Structure Document Data Faster
    • September 15, 2023

about
About
Hello World!

We are liwaiwai.com. Created by programmers for programmers.

Our site aims to provide materials, guides, programming how-tos, and resources relating to artificial intelligence, machine learning and the likes.

We would like to hear from you.

If you have any questions, enquiries or would like to sponsor content, kindly reach out to us at:

[email protected]

Live long & prosper!
Most Popular
  • Intel Innovation 1
    Intel Innovation 2023
    • September 15, 2023
  • 2
    Microsoft And Oracle Expand Partnership To Deliver Oracle Database Services On Oracle Cloud Infrastructure In Microsoft Azure
    • September 14, 2023
  • 3
    Real-Time Ubuntu Is Now Available In AWS Marketplace
    • September 12, 2023
  • 4
    IBM Brings Watsonx To ESPN Fantasy Football With New Waiver Grades And Trade Grades
    • September 13, 2023
  • Data 5
    UK Space Sector Has Sights Set On Artificial Intelligence And Machine Learning Professionals
    • September 15, 2023
  • /
  • Artificial Intelligence
  • Explore
  • About
  • Contact Us

Input your search keywords and press Enter.