Big Data Automation product is a extension module to Workflows & Scheduling that allows to Schedule and Meta-Schedule all Big Data frameworks. As modern scientific and engineering problems grow in complexity, the computation time and memory requirements increase and parallel computing becomes a necessity. ProActive integrates with de-facto standards in scientific and engineering environments such as R Language, Spark, Hadoop, Kafka, Matlab, TIBCO Spotfire, SAS, Talend, Oracle OWB, Python Anaconda, Greenplum. You can also orchestrate and automate all the major Machine Learning and Image Analysis frameworks such as TensorFlow, OpenCV, Caffe, MLlib, Keras, Scikit-learn, Scikits-image with ready to use Workflows. Directly from within these familiar environments, it provides users with the capacity to distribute executions and manage data transfers on other Desktop machines, Clusters, Grids and Clouds. A single tool for accelerating all your languages and tools.Main Features Try It!
We know that a single language cannot fit for every use case, calling for interoperability between multiple languages and services. Create a workflow of multidisciplinary tasks.
Seamlessly parallelize your scientific models and programs from your favorite interactive environment (R Language, Matlab, Scilab). Use Spark and Hadoop platforms from ProActive.
Federate your existing resources (clusters, virtualized infrastructures, desktop machines), add extra resources from clouds. Reduce costs with energy saving strategies and elasticity.
ProActive Big Data Automation comes with a large variety of Connectors, Language Support, and specific Integration, for instance: