Pentaho Tools :

Pentaho C-Tools(CDE,CDF,CDA),Pentaho CE & EE Server,OLAP-Cubes,Analysis using Pivot4J, Saiku Analytics, Saiku Reporting, Ad-hoc Reporting using Interactive Reporting Tool,Dashboards,Reports using PRD, PDD,Data Integration using Kettle ETL,Data Mining usign WEKA,Integration of Servers with Databases,Mobile/iPad compatible Dashboards using Bootstrap Css,Drilldown dashboards,Interactive Dashboards

Wednesday, 2 August 2017

Tip : Query to get latest records from scd type2 product dimension table in DWH using kettle

SELECT * FROM  cdc_timestamp_scd_product_target;

SELECT * FROM cdc_timestamp_scd_product_target
WHERE sk!=0
AND sk IN (SELECT MAX(sk) FROM cdc_timestamp_scd_product_target WHERE sk!=0 GROUP BY product_id)

Monday, 17 July 2017

Jenkins : Create a first build of a Simple Java Program Stored in GitHub in Jenkins

This post talks about how to build a jenkins job using simple java program that is pulled from Github.

Technology Stack :
1) Jenkins
2) GitHub
3) Git Client

1) Create a new repository in GitHub  (Assuming you have a GitHub account)

2) Give repository a name : Say > JavaHelloWorld

3) Observe few commands at newly created repository on below image.
We use add, commit, push commands to send a file to GitHub

4)  (Assuming git client is installed)
Create a folder in D drive say : D:\JavaHelloWorld and put the program and a batch file say run.batch  in which we write javac and java commands to execute the program

Now do gitbash to  add, commit and push the 2 files.

git add
git commit -m "Commiting Java Hello World Program - first"
git push -u origin master

 repeat the same for file (this is added after pushing the JavaHelloWorld file)

5) Start Jenkins in your environment  and build a new project as shown in below
6) Copy/Clone the URL of github

 7) In Jenkins Source Code Management tab provide the gitURL and provide credentails of your github as shown below

8) In Build Triggers tab provide the batch code to run the example. 
In this example, the code is written in run.bat file to execute the hello world program 

 9) Now, click on build project as shown below
9) See the execution log on Console output. 

 10) Navigate to see where the pulled git code stored internally in the OS drive.

Thursday, 13 July 2017

Jenkins : Creating a first build with HelloWorld java program from Windows-7 (Compile & Run)

This post talks about how to create fundamental job and how to build in jenkins by taking a HelloWorld java program.

Environment : Windows 7,  Jenkins 2.60.1

Below are the steps to do.

1) Open jenkins dashboard : http://localhost:8080/
2) Create a new job by clicking on "New Item".

3) Enter a name for the project/job lets say "HelloWorldJob" and chose "Freestyle Project"

4) Navigate to "Build" tab and then select "Execute Windows batch command" and write below to commands to execute the java HelloWorld program that we will put in the job workspace in next step

Click on Apply and Ok to save the job.

java HelloWorld

5) Put file in Project workspace

Location of workspace: C:\Program Files (x86)\Jenkins\workspace

NOTE : Unless you build the job at least for 1 time, the jenkins engine will not create job/project workspace in above location

So, build the job for the first time without the file to get the workspace created.

Click on "Build Now" as shown in below

Check whether the workspace is created or not

6) Now, put "" file in "HelloWorldJob" workspace

public class HelloWorld {
    public static void main(String args[]){
        System.out.println("I'm dancing");
7) Now, if you look at, in jenkins dashboard, the file is loaded in the job workspace. 

8) Now click on "Build Now" to run the job

  The light blue indicates the job ran successfully.

9) Now, click on "Console Output" as shown in below to see the output of the build

10) Console output


Tuesday, 11 July 2017

Kubernetes : Deploying and Scaling a Container in Kubernetes (Using Yaml file)


Before learning how to deploy containerized image(s) to single node kubernetes cluster, you should go through below two articles explained.

1) Build a docker image and push to docker hub : click here
2) Learn how to deploy the container to kubernetes single node cluster using commands  : Click here

Learn how to deploy the container to kubernetes using yaml file :
Follow below list of commands explained

Docker to kubernetes
Yaml file
Deployment through yaml file
.\kubectl.exe create -f sadakarkubernetes2.yaml

apiVersion: extensions/v1beta1
kind: Deployment
  name: sadakarkubernetes2
  replicas: 3
        app: get-started
          image: "sadakar/get-started:part2"
          name: sadakar
              containerPort: 80
Test yaml code from
Expose the deployment as a service
.\kubectl.exe expose deployment sadakarkubernetes2 --type=NodePort
Launch the service
.\minikube.exe service sadakarkubernetes2

URL of the service
.\minikube.exe service --url=true sadakarkubernetes2

kubernetes dashboard: 


Thank you
Sadakar Pochampalli