Posts

Plugin Development for KIbana 5.6

Plugin Development for KIbana 5.6 Setup Development mode for Kibana git clone https://github.com/elastic/kibana.git cd kibana git checkout 5.6 (version of kibana you want to write plugin ,eg.5.6 is my kibana version) Make sure you have the same node version in kibana/.node-version dir Steps to upgrade Node version sudo npm cache clean -f sudo npm install -g n sudo n 6.11.5 Restart the machine to apply changes Note: Just to improve a little bit more this answer, with "n" you can install any node version, so if you want the 8.6.0 version just type : "sudo n 8.6.0" instead "sudo n 6.11.5". Finally restart the machine, to apply changes The Kibana configuration file is kibana.yml and it's located in the config directory. We need to edit this file: $ cd /opt/kibana $ vi config/kibana.yml Kibana defaults to port 5601, but we want to set it explicitly. This port should not conflict with anything on the sand...

Running Hive Queries Using Spark SQL

Image
Running Hive Queries Using Spark SQL Hive queries using Spark SQL. This instructional blog post explores how it can be done. Prerequisite: Hadoop Cluster configured in your system Hive installed and configured with Hadoop Spark installed on the top of Hadoop eco-system Some more configurations need to be done after the successful configuration of Hadoop, Hive, and Spark. Open your spark-env.sh file which is present in the $SPARK_HOME/conf directory and open the spark-env.sh file. Here, add the HIVE_HOME as shown below. 1 export HIVE_HOME=/path_to_hive_installed_directory Now copy the hive-site.xml file present in the $ HIVE_HOME/conf directory to the $ SPARK_HOME/conf directory. In hive-site.xml at   $ SPARK_HOME/conf directory Change hive.execution engine from tez to mr <property>      <name> hive.execution.engine </name>      <value> mr </value>  ...

JAVA CODE : RESTAPI TO ACCESS POSTGRESQL USING ECLIPSE

JAVA CODE : RSETAPI TO ACCESS POSTGRESQL USING ECLIPSE package 1: package com.user.inventory; import java.sql.*; import javax.ws.rs.GET; import javax.ws.rs.Path; //import javax.ws.rs.PathParam; import javax.ws.rs.Produces; //import javax.ws.rs.core.MediaType; //import javax.ws.rs.core.Response; //import javax.ws.rs.QueryParam; import org.codehaus.jettison.json.JSONArray; import com.user.util.ToJSON; @Path("/v/inventory") public class V_inventory { @GET @Produces("application/json") public String returnAllcontacts() throws Exception{ PreparedStatement query = null; Connection conn = null; String returnString = null; try{ Class.forName("org.postgresql.Driver");    conn = DriverManager.getConnection("jdbc:postgresql://localhost:5432/ db "," Username "," password ");    query = conn.prepareStatement("select * from tablename ...