Would the magic behind Streaming Integrator improve OB Business Intelligence?
Hello folks ,
Are you new to the WSO2 Streaming Integrator or WSO2 Open Banking Business Intelligence ? Don’t worry let’s learn about it from scratch.
First lets see what WSO2 Open Banking Business Intelligence is, what it is use for and what the things we can do by using this product.
WSO2 Open Banking Business Intelligence(WSO2 OB-BI) product enables monitoring API analytics, Transaction Risk Analysis, Fraud Detection and Data reporting. And it also generates statistics using the data collected from WSO2 Open Banking Identity Access Management (WSO2 OB-IAM) and WSO2 Open Banking API Manager(WSO2 OB-AM).
The main purpose of using WSO2-OB-Business Intelligence is PSD2 Data Reporting. Lets discuss these very briefly as it is very important to know.
Please consider that I have used WSO2 OB-BI — 2.0.0 , WSO2 OB-AM 2.0.0 and WSO2 OB-IAM 2.0.0.
Let look into features of WSO2 OB-BI simply.
API Analytics
According to the APIs deployed in WSO2 Open Banking API Manager, it provides reports, statistics and graphs.Third-party providers can monitor how their applications perform while banks can analyze how the bank APIs performed.
Transaction Risk Analysis
It enables analyzing the risk level based on predefined rules and exempt the user from having to provide the second factor.
Fraud Detection
It used to detect unauthorized or fraudulent transactions and generate alert and to the identified level of risk and recurrence of the payment transaction
Data reporting
Data Reporting is the process of processing and summarizing these data.The WSO2 Open Banking Business Intelligence(WSO2 OB-BI) captures data published in WSO2 OB-AM and WSO2 OB-IAM.
Here this is a sample of the dashboard that displays the functions of WSO2- Open Banking Business Intelligence.
The following link will help you to setup WSO2 OB-BI.
Now you might think,
What PSD2 is?
Payment Services Directive Two (PSD2) is a piece of legislation designed to force providers of payment services to improve customer authentication processes and to also bring in new regulation around third-party involvement.
When enabling open banking services, the standards and requirements offer as a PSD2 compliant organization.
Then what PSD2 data reporting is?
Open Banking Solution offers a feature in order to make the Acount Servicing Payment Service Provider’s (ASPSPs) statistics available to respective national authorities and open banking authorities to monitor compliance with PSD2/RTS.
The Data Reporting feature enables to gathering and monitoring data in regard to the APIs invoked through the WSO2 Open Banking solution.
Now it is time to know about what Streaming Integrator does, and what is the magic behind it.
WSO2 Streaming Integrator (WSO2 SI) is a streaming data processing server that integrates streaming data and takes action based on streaming data. The language which performs a major role in WSO2 Streaming Integrator is siddhiQL which is like an intuitive SQL. And it allows you to write complex stream processing logic and perform actions on the fly using siddhi queries and constructs.
Please consider that I have used WSO2 Streaming Integrator v1.1.0
The main functions we can play with WSO2 Streaming Integrator are,
Extracting data from static sources in real time.
- Loading and writing data to databases, files and cloud based storages.
- Receiving data in transit from message brokers and data publishers.
- Publishing Data to destinations.
- Stream processing activities including cleansing, transforming, enriching correlating, and summarizing data.
- Performing real time ETL.
We can use WSO2 SI to connect any data source with any destination regardless of different protocols and data formats used by the different endpoints as it consists with 60 + prebuilt and well tested collection of connectors.
The SI Store API exposes aggregated and collected data streams to in-memory and persistence storages via a REST API, allowing you to execute queries and generate summarized information on demand.
Here we go …
The summarized information is most important part of data reporting. Now we might think of using WSO2 streaming integrator to improve WSO2 Open Banking Business Intelligence.
Is it possible to improve WSO2 Open Banking Business Intelligence using Streaming Integrator? Is there any possibility to verify it?
My answer is YES !!!
Through my intern project, I have revealed that WSO2 Streaming Integrator can be improved WSO2 Open Banking Business Intelligence using 4 steps as below.
- We have to install WSO2 Streaming Integrator Server , WSO2 OB Api Manager and WSO2 OB Identity Access Management.(( should be setup as WSO2 OB-BI)
- Then deploy the siddhi apps (which are already deployed in WSO2 Open Banking Business Intelligence) to {WSO2_SI_HOME}/deployment/siddhiApps.
3. Then you have to add necessary libraries for extensions used in siddhi apps.
4. At end you need to add configs (the same configs that added to WSO2 Open Banking Business Intelligence) to deployment.yaml in WSO2 SI server.
WSO2 Streaming Integrator provides a component called WSO2 Streaming Integrator Tooling. We can use tooling platform verify that data is receiving from any data source with any destination and at the same time we can verify that data is publishing or not.
By using the following code, we can verify that data is receiving to WSO2 Streaming Integrator. It displays data that receiving from data source in the console.
The below code should be placed after the stream name.
@sink(type=’log’ , @map(type=’passthrough’))
Therefore we don’t need to make much effort to test our siddhi apps as it is more user friendly.
Not only for data reporting, we can use WSO2 Streaming Integrator for adding more functions very easily .
Hope you’ll enjoy this game. See you in next article.
References