How does a distributed Job scheduler work?

5 min

Mar 28, 2018 from Activeeon

How does a distributed Job scheduler work?

Job scheduler is a workload automation tool that allows automating and integrating business & IT processes and tasks (sequential and parallel jobs and orders) across different virtual machines and computing environments. Thanks to its unique console, the scheduler will give you a centralized view of operations at your project, from organizational point of view.

Our job scheduler services: ProActive Workflows & Job Scheduling

Our job scheduling software allows you to easily distribute and execute all company jobs and business applications, monitor activity and view jobs results. It ensures more work done with fewer resources, managing heterogeneous platforms and multiple sites. It maximizes utilization of both existing and Cloud IT infrastructures.

Java Job scheduler and its specifications

Workflow Studio: Easily design efficient workflows to automate the execution of your workloads

The Workflow Studio provides an easy to use job scheduler’s graphical interface for creating your workflows as a representation of your distributed computations. By defining one or more tasks and their dependencies, you are able to set advanced flow controls such as replication, if/else branching and loops. Workflow Studio is directly accessible from your web browser.

Web Portals: Everything from your web browser

The Job Scheduler Web Portal is dedicated to users running workflows. From there you can submit workflows, monitor their execution and retrieve results. Remote visualization of graphical tasks is also possible directly from the browser. Progress of Workflow execution is graphically visible in the portal.

The Resource Manager Web Portal allows administrators to operate the platform and users to monitor their resources. It is the place where you can connect compute resources and monitor them, and even control dynamic policy-based provisioning of resources.

Resource Management: Aggregate resources to reduce infrastructure costs

Aggregate and manage resources from different infrastructures. Resources coming from multiple origins are unified as ProActive Nodes and can be accessed transparently: Desktop machines (Windows, Linux, MacOS X), all kind of stand-alone server machines, cluster nodes managed by common batch-schedulers (Slurm, LSF, SGE) and private or public Clouds resources (OpenStack, CloudStack, VMWare, Windows Azure, Amazon EC2, Numergy, etc.).

Control the resources acquisition behavior with job scheduler service according to various policies such as Load based or Time based.

Desktop Agents: Keep the control of your machines

Desktop machines are often under-used IT resources. Desktop Agent smart software offers this computational power in a unified platform, while keeping usage under control for the sake of desktop end-users. It runs as a background service under a restricted user and does not interfere with the day-to-day usage of the desktop machine. Typical configuration consists in the definition of a weekly working plan (like night or weekend) or limitation of memory and CPU usage. Desktop Agents are currently available for Windows (XP, Vista, 7), MacOS X and Linux.

Jobs’ Monitoring: Unified supervision for your resources and applications

Workflows & Job Scheduling cares about your time and money, helping you troubleshooting any inconveniences you may experience during the execution or development of your business software by providing a very wide range of monitoring mechanisms accessible through our Web Portals and APIs.

Thanks to job scheduler, you can supervise your jobs and its tasks, and get fine details on its duration, results, execution node, and failures and more. Get the state of your execution nodes themselves: disk space left, CPU usage, memory usage, network usage, disk IO usage, list of processes. Do not forget to use job scheduler to supervise your virtual resources: as your infrastructure grows with our cloud connectors, your supervision and control on the new virtual resources will grow too, allowing you to get vendor specific information from the IaaS service provider monitoring API.

Fault Tolerance: Be sure to get things done

Job failures might occur caused by a brief anomaly in the execution node, so marking a job as failed in such conditions could represent a waste of resources. With job scheduler we let you configure your workflow and specify policies of re-scheduling that better by adjusting to your needs.

Network failure is a phenomenon that every system administrator is aware of. Activeeon’s solution: job scheduler Java, handles these scenarios and makes a best effort to recover computations executed in a lost node once it is back, saving your time and money.

Thanks to scheduler service, outages will not mess your business up! The solution preserves the state of the scheduler, all your job results and its logs.

Energy Saving: Prepare your IT for future regulations

Energy saving is not only an option: it is also a way to be prepared to regulation regarding the energy consumption in IT departments.

Green IT in ProActive is achieved with resource policies. Scheduler service will give you control over resources acquisitions and will let you promote elasticity thanks to On-Demand Computing, Desktop Machines Recycling and Cloud Bursting.

Why to go for job scheduler java provided by Activeeon?

  • Scheduler service will reduce the overall operation costs and improve the ROI of IT Automation
  • Fault tolerance – job scheduler will reduce errors of manual operations
  • Manage resource elasticity
  • Insure infrastructure high availability
  • Distributed job scheduler is fast & simple to use
  • Distributed job scheduler will give you an overview at all running processes and their evolutions, data updated

More articles

All our articles