There are many business systems in the enterprise that can only provide WebService interfaces such as SAP, and some SaaS systems only provide WebService interfaces such as Workday, etc. For the data of these systems, we can use ETL tools to call and then parse the data in XML Then store it in the database or synchronize it to other local business systems. Using the RestCloud ETL tool can complete the synchronization of the above data in two simple steps without coding. Now let's take a look at the implementation process.
First log in to the RestCloud ETL platform
Use ETL to call the WebService interface to pull data in real time to the local database
to open an application or create a new application, and then enter the process list
Use ETL to call the WebService interface to pull data in real time to the local database
to create a WebService synchronization task
Use ETL to call the WebService interface to pull data into the local database in real time.
From the left, pull a WebSerivce node and a database table output node respectively. We choose the mysql data source for the target node.
Use ETL to call the WebService interface to pull data in real time into the local database,
enter the WSDL address of the WebService and specify the data field we want to read returned in the XML, here we will obtain a WebService interface service address on the public network as follows:
Use ETL to call the WebService interface to pull data into the local database in real time. The
above is the service description document of this WebSerivce. We call one of its methods to obtain the area and encoded data and then transfer it to mysql for storage.
Use ETL to call the WebService interface to pull data into the local database in real time. The
XML input parameters can be parsed by the SoapUI tool and then copied in, so that our WebService node configuration is complete.
The latter MySql node is relatively easy. You can build the table in advance, or the table can be automatically created by the ETL task. Here we choose to automatically build the table by the ETL tool and output the data to mysql.
Use ETL to call the WebService interface to pull data into the local database in real time.
Just enter a table that does not exist here, and the system will automatically create this table.
Use ETL to call the WebService interface to pull data into the local database in real time,
and then configure the field of this table to receive data, and the system will create the database table according to this configuration field.
Use ETL to call the WebService interface to pull data in real time to the local database.
In the output option, we choose to clear the target table at the first execution, automatically build the table, and update one by one. After the configuration is completed, save the process and start debugging. Now Let's run it to see the effect.
Use ETL to call the WebService interface to pull data in real time to the local database
, click Run, select single-step debugging, you can see the pulled area data, and it will be stored in mysql
Use ETL to call the WebService interface to pull data into the local database in real time.
In the debugging interface, we can see that 79 pieces of data have been pulled, and then click Next to store them in mysql.
Use ETL to call the WebService interface to pull data into the local database in real time.
The task execution result shows that 79 pieces of data have been successfully transferred to mysql. We can go to the mysql table to preview whether the regional data has been pulled into mysql.
Use ETL to call the WebService interface to pull data in real time to the local database.
Open the mysql client and you can see that the data in WebSerivce has been successfully pulled to the local mysql. If there is no problem with debugging, we can arrange a scheduled task for him. Synchronize the data in the webservice to the local.
Use
ETL to call the WebService interface to pull data into the local database in real time.
You can choose to synchronize once every night or other synchronization times. You can customize the synchronization frequency
Above, we implemented the data pull synchronization task of the WebService interface through the simple two-step configuration of RestCloud ETL, which can be said to be very simple.
