Home	CloverETL Server

CloverETL Server

Table of Contents

1. What is CloverETL Server

2. Installation

Apache Tomcat

IBM Websphere

Glassfish / Sun Java System Application Server

Possible issues during installation

3. Graphs on Server Side - Sandboxes

Referencing files from the graph

Sandbox Security and Permissions

Sandbox Content

Graph config properties

4. Users and Groups

LDAP authentication

Web GUI section Users

Web GUI section Groups

5. Scheduling

Timetable Setting

6. Graph Event Listeners

Graph Events

7. JMS messages listeners

Optional Groovy code
Message data available for further processing

8. Universal event listeners

Groovy code

9. Manual task execution

10. File event listeners

Observed file

File Events

Check interval, Task and Use cases

WebDAV clients

WebDAV authentication/authorization

12. Simple HTTP API

Operation help
Operation graph_run
Operation graph_status
Operation graph_kill
Operation server_jobs
Operation sandbox_list
Operation sandbox_content
Operation executions_history
Operation suspend
Operation resume

13. JMX mBean

JMX configuration

14. SOAP WebService API

SOAP WS Client
SOAP WS API authentication/authorization

15. Launch Service

Launch Service Overview
Deploying Graph in Launch Service
Designing the Graphs for Launch Service
Configuring the Graph in CloverETL Server web GUI
Sending the Data to Launch Service
Results of the Graph Execution

16. Configuration

Config Sources and Their Priorities

Examples of DB Connection Configuration

Embedded Apache Derby

Postgre SQL

JNDI DB DataSource

List of Properties

17. Graph parameters

Another sets of parameters according the type of execution

executed from Web GUI
executed by Launch Service invocation
executed by HTTP API run graph operation invocation
executed by RunGraph component
executed by WS API method executeGraph invocation
executed by task "graph execution" by scheduler
executed by task "graph execution" by graph event listener
executed by task "graph execution" by file event listener

How to add another graph parameters

Additional "Graph Config Parameters"
Task "execute_graph" parameters

18. Recommendations for transformations developers

Add external libraries to app-server classpath
Another graphs executed by RunGraph component may be executed only in the same JVM instance

19. Logging

Main logs
Graph run logs

20. Extensibility (Embedded OSGi framework)

Plugin possibilities
Deploying an OSGi bundle

21. Extensibility CloverETL engine plugins

22. Clustering

High Availability

Scalability

Transformation Requests

Parallel Data Processing

Recommendations for Cluster Deployment

Example of Distributed Execution

Details of the Example Transformation Design

Scalability of the Example Transformation

Cluster configuration

Mandatory properties
Optional properties
Example of 2 node cluster configuration
Load balancing properties

List of Figures