Better Forecasting with AI-Powered Time Series Modeling

0
366
Better Forecasting with AI-Powered Time Series Modeling


AI-powered Time Series Forecasting could be the strongest side of machine studying out there right this moment. Working from datasets you have already got, a Time Series Forecasting mannequin will help you higher perceive seasonality and cyclical conduct and make future-facing choices, akin to decreasing stock or workers planning. By simplifying Time Series Forecasting fashions and accelerating the AI lifecycle, DataRobot can centralize collaboration throughout the enterprise—particularly information science and IT groups—and maximize ROI.

AI Forecasting Can Overcome Real-World Complexity and Integrate Existing Processes  

While AI-powered forecasting will help retailers implement gross sales and demand forecasting—this course of may be very complicated, and even extremely data-driven corporations face key challenges:

  • Scale: Thousands of merchandise mixtures make it tough to manually construct predictive fashions 
  • Real-World Complexity: The fixed altering situations of demand swings, uncontrolled components, such because the COVID pandemic, and inner actions are onerous to forecast in opposition to and might render fashions ineffective in a single day
  • Integration and Disparate Tools: Within the identical group you may need completely different groups working with completely different applied sciences, instruments, and frameworks, so there’s a problem in constantly of forecasting solutions, making alignment harder and slowing down time to worth 

Why is it so tough to do it manually? For instance, simply to forecast gross sales on a shirt with 5 completely different sizes in 5 completely different colours provides you 25 mixtures. Now, add over 5,500 retailer places with a 7-day rolling forecast—which really takes 42 days to forecast—and also you’ll get greater than 5 million predictions. 

Forecasting for one single item leads to more than five million predictions
Forecasting for one single merchandise results in greater than 5 million predictions

This is the place the DataRobot AI platform will help automate and speed up your course of from information to worth, even in a scalable setting. Let’s run by way of the method and see precisely how one can go from information to predictions. 

The use case might be forecasting gross sales for shops, which is a multi-time sequence downside. (supervised studying and time sequence regression). In this use case, the forecasting might be on a day decision, however for different Time Series Forecasting, the decision may be completely different, akin to a month, a 12 months, and so on.

The course of I’ll current might be utilizing the DataRobotic GUI. For code-first customers, we provide a code expertise too, utilizing the AP—each in Python and R—in your comfort.

Setting up a Time Series Project

The machine studying life cycle at all times begins with the dataset. Import the information from varied choices: from a neighborhood file or URL or create an information reference to various information sources, akin to Snowflake or Amazon Redshift, and add it to the AI Catalog, which helps handle datasets, versioning, and shared capabilities with different customers. 

If your dataset isn’t in time order (time consistency is required for correct Time Series tasks), DataRobotic can repair these gaps utilizing the DataRobotic Data Prep device, a no-code device that may get your information prepared for Time Series forecasting. 

Prepare your data for Time Series Forecasting - DataRobot AI Platform
Prepare your information for Time Series Forecasting

Once the information is prepared, DataRobotic will do some preliminary exploratory information evaluation –  along with an information high quality evaluation of the information – to get a deeper understanding of the dataset previous to mannequin coaching. As you dive in, you may take a look at the distribution of every characteristic, establish outliers, goal leakage, or lacking information, create a var transformation, higher perceive what these options could also be, and extra.

Perform exploratory data analysis - DataRobot
Perform exploratory information evaluation

Once the information is able to begin the coaching course of, it’s worthwhile to select your goal variable. When we select ‘sales’ it’s instantly acknowledged as a regression downside. Note: the DataRobotic platform helps each supervised and unsupervised studying

Configuring an ML project - DataRobot
Configuring an ML mission

Next, it’s worthwhile to arrange the time-aware modeling settings, together with the Feature Derivation Window (FDW), or how lengthy of a interval you could must generate options that might be related in your downside. Then generate a Forecast Window—which reveals the futures interval you need to forecast—and the operationalize hole (the time frame for which forecasted predictions can’t be made actionable).

Settings for Time Series projects - DataRobot AI Platform
Settings for Time Series tasks

Calendars may enable you to perceive seasonality and incorporate it into the forecast mannequin. For instance, how holidays and occasions have an effect on forecasting. If you don’t have your individual calendar, DataRobotic will generate one primarily based in your location. 

Attach calendar for TS projects - DataRobot
Attach calendar for TS tasks

Advanced settings will let you configure further parameters to the forecasting mission, like “known in advance” (KA) options—that don’t change after the forecast level—akin to advertising and marketing promotions, vacationer occasions, and extra.

I may additionally configure the mission primarily based on section, which is able to end in a number of tasks “under the hood.” Once the segments are recognized and constructed, they’re merged to make a single-object—the Combined Model. This results in improved mannequin efficiency and decreased time to deployment.

Select KA Features that will not change after the forecast point - DataRobot
Select KA Features that won’t change after the forecast level

The DataRobotic Training Process

Now that every one our settings are in place, we’re able to go. To start coaching your mannequin, simply hit the Start button and let the DataRobot platform prepare ML fashions for you. Based on the FDW, new options might be generated. You can dive into every certainly one of them and discover the characteristic lineage, permitting you to see the transformation from the unique characteristic to the one which was created.

Explore Feature Lineage to see the transformation from the original feature to the one that was created - DataRobot
 Explore Feature Lineage to see the transformation from the unique characteristic to the one which was created

You may see the correlation between every characteristic and the goal variable. In the background, fashions are being skilled in parallel for effectivity and pace—from Tree-based fashions to Deep Learning fashions (which might be chosen primarily based in your historic information and goal variable) and extra.

To speed up the method, you can too improve the variety of modeling staff (variety of jobs operating on the similar time).

A variety of models are been trained in parallel - DataRobot
Quite a lot of fashions are been skilled in parallel

After your mission has been finalized, you may overview all of the fashions that have been skilled. The order of the fashions might be primarily based on the mission’s metric—and may be modified primarily based in your configuration. In the coaching course of, completely different fashions with completely different characteristic lists and coaching durations have been examined, and solely the most effective performing fashions continued to the subsequent spherical, ensuing within the first mannequin listed within the leaderboard, which is the advisable mannequin by DataRobotic for deployment. 

The Leaderboard of trained models—ordered based on your metric - DataRobot
The Leaderboard of skilled fashions—ordered primarily based in your metric
Changing the order of the Leaderboard based on a different metric - DataRobot
Changing the order of the Leaderboard primarily based on a special metric

The mannequin coaching course of isn’t a black field—it consists of belief and explainability. You can see the complete course of from information to predictions with all the completely different steps—in addition to the supportive documentation on each stage and an automatic compliance report, which is essential for extremely regulated industries. 

DataRobot Blueprint—from data to predictions. ML pipelines containing preprocessing steps, modeling algorithms, and post-processing steps.
DataRobotic Blueprint—from information to predictions. ML pipelines containing preprocessing steps, modeling algorithms, and post-processing steps.
Generate Model Compliance Documentation - DataRobot
Generate Model Compliance Documentation

Model Performance, Insights, and Explainability

Do you need to see how your mannequin is performing? Looking at Accuracy Over Time lets you see the actuals versus the predictions of the mannequin—and reveals how seasonality and calendar occasions are integrated. Advanced Tuning, in the meantime, will allow you to additional tweak the mannequin. 

Track Accuracy Over Time to see the actuals versus the predictions of the model - DataRobot
Track Accuracy Over Time to see the actuals versus the predictions of the mannequin

Are your small business choices aligned with the mannequin outcomes? On a macro stage, see which options drive the mannequin’s final result. On a micro stage, uncover how a change in a particular characteristic impacts the goal variable. For instance, selecting the ‘tourist event’ characteristic reveals us that holding such occasions ends in greater gross sales.

All of the from the platform will also be exported exterior of DataRobotic. 

See which features contribute most to the model - DataRobot
See which options contribute most to the mannequin 
How each feature contributes and affects the target variable - DataRobot
How every characteristic contributes and impacts the goal variable

The Deployment Process

Now it’s time to place our mannequin into manufacturing and get some predictions—and unlock actual worth and ROI. There are a number of methods to take action. Perform advert hoc evaluation in your dataset and preview the predictions for the upcoming seven days for a particular sequence. You may deploy the mannequin utilizing the DataRobotic API—guaranteeing a clean and quick connection between information scientists and the IT group.

Make predictions, deliver value, and unlock ROI - DataRobot
Make predictions, ship worth, and unlock ROI
Perform ad hoc analysis and preview upcoming predictions - DataRobot
Perform advert hoc evaluation and preview upcoming predictions

In normal, utilizing DataRobot MLOps, you can too see fashions that you just at present have in manufacturing—from completely different coaching and deployment environments. Check for mannequin accuracy and information drift and examine every mannequin from governance and repair well being views, respectively. If your mannequin is decaying, you may change it with a extra correct challenger mannequin—which may be monitored with automated guidelines and notifications. 

Deploy your model using the DataRobot API
Deploy your mannequin utilizing the DataRobotic API
Check all your models at a glance - DataRobot
Check all of your fashions at a look
Monitor model accuracy over time in production - DataRobot
Monitor mannequin accuracy over time in manufacturing 
Challenger models compete against the champion model - DataRobot
Challenger fashions compete in opposition to the champion mannequin

Close the loop by connecting your predictions into any database—together with batch or real-time predictions utilizing the DataRobotic API. And to connect with the enterprise, you may join predictions to your small business software. For instance, I used Tableau on this use case. On the highest, you may see the general forecasted gross sales for the subsequent seven days in all of the shops mixed, and on the underside, you may have every sequence (every retailer) displayed individually. 

Connect predictions to your business application - DataRobot
Connect predictions to your small business software

Accelerate the Machine Learning Life Cycle with AI-Powered Forecasting

Time Series Forecasting is likely to be essentially the most highly effective side of machine studying out there to organizations right this moment. The capability to strategically plan for what’s to come back can set you aside out of your competitors. 

With accessibility from the UI, but additionally from code—and with Trusted AI and explainability to assist improve the worth and unlock ROI—the DataRobotic platform will help your group rapidly make correct predictions and get actionable insights.

To see a demo on how one can leverage AI to make forecasting higher, and speed up the machine studying life cycle, please watch the total video, AI-Powered Forecasting: From Data to Consumption.

AI Experience 2022 Recordings

AI-Powered Forecasting: From Data to Consumption


Watch On-Demand

About the creator

Atalia Horenshtien
Atalia Horenshtien

Global Technical Product Advocacy Lead, DataRobotic

Atalia Horenshtien is a Global Technical Product Advocacy Lead at DataRobotic. She performs a significant function because the lead developer of the DataRobotic technical market story and works carefully with product, advertising and marketing, and gross sales. As a former Customer Facing Data Scientist at DataRobotic, Atalia labored with clients in numerous industries as a trusted advisor on AI, solved complicated information science issues, and helped them unlock enterprise worth throughout the group.

Whether talking to clients and companions or presenting at trade occasions, she helps with advocating the DataRobotic story and undertake AI/ML throughout the group utilizing the DataRobotic platform. Some of her talking classes on completely different subjects like MLOps, Time Series Forecasting, Sports tasks, and use circumstances from varied verticals in trade occasions like AI Summit NY, AI Summit Silicon Valley, Marketing AI Conference (MAICON), and companions occasions akin to Snowflake Summit, Google Next, masterclasses, joint webinars and extra.

Atalia holds a Bachelor of Science in industrial engineering and administration and two Masters—MBA and Business Analytics.


Meet Atalia Horenshtien

LEAVE A REPLY

Please enter your comment!
Please enter your name here