SOLR Cloud(3)JDBC Driver and ZooKeeper

SOLR Cloud(3)JDBC Driver and ZooKeeper

DBVisualizer
zookeeper link
https://lucene.apache.org/solr/guide/6_6/solr-jdbc-dbvisualizer.html

SQuirreL SQL
require zookeeper link
https://lucene.apache.org/solr/guide/6_6/solr-jdbc-squirrel-sql.html

Since they all need zookeeper, I think I need to set up SOLR Cloud
http://sillycat.iteye.com/blog/2394077
http://sillycat.iteye.com/blog/2395070

zookeeper cluster
http://blog.csdn.net/LLQ_200/article/details/56675629
https://github.com/denverdino/aliyungo/wiki/Zookeeper-cluster-with-Docker
https://docs.docker.com/samples/library/zookeeper/
https://hub.docker.com/_/zookeeper/

https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/create_deploy_docker_ecs.html#create_deploy_docker_ecs_listeners
(adding TCP listeners)
https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/create_deploy_docker_v2config.html  AWS Docker configuration

Prepare the EB command line ENV on CentOS
>pip install awsebcli --upgrade --user

Verify the installation
>eb --version
EB CLI 3.12.0 (Python 2.7.1)

Prepare the EB command line ENV on Mac
>brew update
>brew install awsebcli
>eb --version
EB CLI 3.11.0 (Python 2.7.1)



Need to check if there is other way to do Health Check on that
https://www.npmjs.com/package/express-healthcheck

Here is how we increase the Heap Size of the Zookeeper
http://whatizee.blogspot.com/2015/03/increasing-zookeeper-heap-size.html

Here is the operation I did from the zookeeper client to verify if zookeeper server is working
http://www.corejavaguru.com/bigdata/zookeeper/cli

Some zookeeper configuration key
https://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html

Our zookeeper docker image is built on top of this Docker config
https://github.com/31z4/zookeeper-docker/blob/master/3.4.10/docker-entrypoint.sh
https://github.com/31z4/zookeeper-docker/blob/master/3.4.10/Dockerfile
https://docs.docker.com/samples/library/zookeeper/#zoo_servers

How to Make Zookeeper Docker Work
Makefile
IMAGE=sillycat/zookeeper
TAG=latest
NAME=zookeeper
REPOSITORY=xxxxxxx.dkr.ecr.us-east-1.amazonaws.com

docker-context:

build: docker-context
docker build -t $(IMAGE):$(TAG) .

debug:
docker run -ti -p 2181:2181 -p 2888:2888 -p 3888:3888 --name $(NAME) $(IMAGE):$(TAG) /bin/bash

run:
docker run -p 2181:2181 -p 2888:2888 -p 3888:3888 --name $(NAME) $(IMAGE):$(TAG)

tag:
docker tag $(IMAGE):$(TAG) $(REPOSITORY)/$(IMAGE):$(TAG)

push:
docker push $(REPOSITORY)/$(IMAGE):$(TAG)

clean:
docker stop ${NAME}
docker rm ${NAME}

Dockerfile
FROM    zookeeper:3.4.10

COPY    java.env $ZOO_CONF_DIR
COPY    start.sh $DISTRO_NAME
CMD     [ "./start.sh" ]

start.sh
#!/bin/sh -ex

CONFIG="$ZOO_CONF_DIR/zoo.cfg"

echo "Purge the snapshots and corresponding transaciton logs every hour"
echo "autopurge.purgeInterval=1" >> "$CONFIG"

echo "Do not log healthchecks"
echo "log4j.org.apache.zookeeper.server.NIOServerCnxn=ERROR" >> $ZOO_CONF_DIR/log4j.properties

zkServer.sh start-foreground

java.env
export JVMFLAGS="-Xmx3072m"

We can easily build and run the docker images and applications from these configuration files.


References:
https://lucene.apache.org/solr/guide/6_6/velocity-search-ui.html
http://localhost:8983/solr/job/browse?q=select+*+from+job

more UI tools
http://blogs.avalonconsult.com/blog/search/apache-solr-jdbc-introduction/
SQuirreL SQL
https://lucene.apache.org/solr/guide/6_6/solr-jdbc-squirrel-sql.html
ui tool, dbvisualizer
https://lucene.apache.org/solr/guide/6_6/solr-jdbc-dbvisualizer.html
jdbc driver manager
https://github.com/bluejoe2008/solr-sql
https://sematext.com/blog/solr-6-as-jdbc-data-source/
java SQL manager java.sql.DriverManager
https://dzone.com/articles/solr-6-as-jdbc-data-source
Metabase
http://www.jianshu.com/p/f6b5cf74f57d
http://www.jianshu.com/p/2qimbD
https://github.com/metabase/metabase

exhibitor
http://www.bijishequ.com/detail/448804?p=
http://blog.csdn.net/pinganting/article/details/53189259
https://github.com/soabase/exhibitor