Don't waste another minute with repetitive tasks and focus on improving your IT business! Use ActiveEon, award winning SOAP software & ML data pipeline automation.
ProActive Workflows & Scheduling
Drive efficiency, reduce costs and automate operations from simple tasks to complex processes.
ProActive AI Orchestration
Industrialize your processes, accelerate the AI deployment and improve your AI success rate.
Discover all new features, expansions, and hot fixes as released in the products' latest versions.
Orchestrate automation across all ERP, ITSM, ETL/ELT, and across your hydrid environment.
Why ActiveEon is Better & Faster
ActiveEon provides the most advantageous, efficient and fastest solutions.
Powerful and easy workflow management software for IT automation.
Automatically execute IT and business processes on hybrid cloud and on-premises resources, provide self-service portal and reduce support cost.
Hybrid IT Enabler
Maintain a centralized approach to IT governance while exploiting the benefits of cloud computing.
Combine grid computing, parallel computing, and distributed system to outperform your existing results.
Enable process automation across your entire enterprise and hybrid cloud infrastructure.
Monitor & Industrialize Processes
Be efficient in operating and monitoring workload automation - and enable self-service for problem resolution.
Minimize the complexity of AI with repeatable & scalable machine learning life-cycle.
Provides a center of excellence for the production of your AI models.
Higher Education & AI
Use your existing ICT infrastructure and improve AI/ML delivery with ActiveEon.
We provide the most reliable tools to make sure you benefit from a smooth and successful migration that matches your needs and gives you a competitive edge.
ActiveEon Smart Migration Process
Learn more about how to easily switch from your old legacy automation solution to ActiveEon.
Migrate from Dollar Universe
Find out how ActiveEon can help you migrate from Dollar Universe and advantageously improve your process automation.
Discover our dedicated SaaS platform for Job Scheduling and Machine Learning.
Take a look at our documentation to understand the technical aspects of our Workflows & Scheduling and Machine Learning solutions.
Learn how to use our ProActive Workflows & Scheduling and ProActive AI Orchestration in 5 training sessions.
See how to orchestrate Automation Across all ERP, ITSM, ETL/ELT, and Across your Hybrid Cloud.
Join our dynamic and supportive community!
Learn more about workload orchestration, job scheduling, IT automation and machine learning!
Explore our use cases and see how we can help your business.
Discover our customers and references.
Download our whitepapers and get free expert insights!
Browse our video library to watch testimonials, demos, use cases and more!
Learn to use our solutions step-by-step.
ActiveEon is the new automation solution of choice. Learn about who we are and what we stand for.
ActiveEon displaces legacy solutions in worklflow automation by designing state-of-the-art software solutions. See more about our company vision and values.
Explore our latest news, events, press releases, webinars and more!
See where we're located.
We believe that great companies are made of great people. Join our international team and become part of a fast-growing and innovative company!
Get in touch if you have any question, concern or ideas to share with us!
Get information about our competitors and our conversion tools.
Optimize computing resource usage and automate your workloads with modern batch processing
Oct 4, 2023 from Activeeon
Batch processing is a method of running software tasks - called jobs - in batches automatically. In this article, you’ll learn more about batch processing, including: definition, needs and the evolution of batch processing for the modern IT environment.
Batch processing occurs when a computer automates repetitive tasks in a group. It’s a method for running high-volume, automated data jobs without user interaction.
The batch processing method is still very much alive in supporting companies and it can be performed on an as-needed basis or regularly scheduled.
Often literature speaks about the challenges of batch processing as slow, not sophisticated, high latency, not scalable and resources-constrained.
All this may be true if businesses continue to use scheduler solution they bought 20 years ago.
In this document, we’ll discuss how batch processing, supported by a modern scheduler, fits into today’s IT requirements.
As previously indicated, batch processing is still effectively used for IT operations activities, especially at night time. Yet, ITOps, DevOps, and SRE are increasingly utilizing batch processing for even more advanced requirements during working hours.
With the growth of big data and AI, and the advent of advanced schedulers such as ActiveEon, batch processing can provide awesome benefits.
The image below shows how ByDance, the company behind Tiktok, extracts a specific type of data from a large dataset and, by launching individual batches in parallel, obtain several types of data analysis (predictions) based on text, pictures or videos.
The key element in this architecture is the scale of both the compute power to run the algorithms and the capability to manage parallel processing to get the result as soon as possible.
The size of the dataset typically varies during the day, and the IT staff would struggle to continuously adjust the necessary compute capacity in real time.
To that end, and in order to be effective, the scheduler must automatically scale (up and down) the compute resources in accordance with the needs of the batch processing.
The scheduler is actively monitoring the underlying computer resources used by each batch processing and adapt the power accordingly.
Whenever the batch processing requires additional resources to process the job, the modern scheduler is able to provision extra compute power as needed.
For the most advanced needs modern schedulers should also be able to choose the appropriate resources based on the nature of the algorithm.
To demonstrate this idea, consider how a quant analyst running a Montecarlo simulation would require a lot of CPU power to crunch the data, as opposed to a marketing executive working on texts or photos, who would require compute power with a lot of RAM.
Modern schedulers triages the batch processing toward the appropriate group of compute resources for better results.
These sophisticated schedulers are increasingly referred to as orchestrators.
Want to see for yourself?
The second key element in the use case is parallel processing.
Several batch processes are working concurrently processing different data from a single dataset.
Each parallel batch process uses a set of dedicated CPU or GPU to crunch the algorithm at the same time.
Because end users may utilize software from several sources, firms frequently adopt a hybrid environment for this.
At a German Bank based in London, an example of a typical use case is:
Batch processing which is often used in regular schedule is increasingly used on as-needed basis.
There are many situations that can cause a batch job to start, such as when a customer downloads a file from your company website for analysis or when the accounting department requests an ad-hoc report that requires access to several different programs and databases.
A modern scheduler has the ability to listen for events and run a series of batch operations to complete the process.
Overall, batch processing is still very much in use and is one of the essential instruments in the arsenal of a successful IT operation manager.
If you want to know how advanced batch scheduling can be used for your advanced requirements, please get in touch with us so that we can show you some real use-cases of awesome batch processing jobs.
Batch processing is used to execute many tasks or non-interactive jobs at once. It is used where a fast response time is not critical or for very large files....
Jul 18, 2023 from Activeeon
In this blog, we will address the complexity of deploying and monitoring LLMs and show you how to simplify it using ProActive AI Orchestration and its MLOps Dashboard....
Jun 23, 2023 from Activeeon
Dans cet article, nous allons présenter le tableau de bord AI Orchestration et ses fonctionnalités, caractéristiques et interfaces. Le tableau de bord se compose de 3 onglets principaux....
All our articles