by yanivp
tags:
border:

Java native memory leak detection When thinking about memory leak in Java we usually think about Java heap leak where objects are allocated in the heap are not being garbage collected. That was what I was thinking when working on a memory leak in one of our servers, but what...

by yoavn
tags:
border:

Unit and Integration tests for Java & Redis Recently I worked on a project which was using Redis as its database. Many projects I worked on before had one or even multiple databases. From those projects I still remember the endless discussions on how to unit test my code, mocking,...

border:

Javascript For Java Developers Javascript For Java Developers There are times that a java programmer needs to write some javascript functions for an eco system that does not have a framework. For example I am working with BigQuery (google’s big data platform) and writing user functions that are in javascript....

tags:
border:

Following our successful event we're happy to share the videos & slides with you. Implementing Machine Learning with Spark MLlib by Ran Silbermal. Implement ML on real world problems using Spark MlLib. In this lecture we will show different algorithms that can be used and compare between them .Code will...

by yoavn
tags:
border:

Following my successful lecture I’d like to share the vidro & slides with you. In this session we learn how to package your code using Java's new modules. Benefit from cool features such as JShell and find out what else is new Java 9. This session will explain how these...

border:

AppEngine Dataflow SpringBoot In a past blog I wrote about Scheduling Dataflow pipeline. There I described how to leverage google's app engine and cron server to schedule dataflow pipelines. For simplicity I had used java spark as the web server. Thought now I have decide that spring boot is more...

border:

Apache Beam Testing So you decided to join the wagon of apache beam. Now that you have written your pipeline, you would like to test it. Apache beam has a full framework for testing your code. You can test each function, Composites, and even a full pipeline. For the full...

tags:
border:

Apache Beam Good Bad and the Ugly I would like to share with you my experience with apache beam on the latest project that I have worked on. Senario My project was an ETL from salesforce to bigquery. Since we need to do this with a lot of tables and...

tags:
border:

BigQuery I have been working on BigQuery for a few months and would like to share what I have learnt. What is BigQuery? BigQuery is a SAS Database platform by google. BigQuery is very similar to RDBMS, and you use SQL to work with it. The main advantage of BigQuery...

border:

Scheduling Dataflow pipelines Google has a product called Dataflow. Dataflow is a engine for processing big data. Google took the dataflow model and externalized it as Apache Beam Model (see https://beam.apache.org). The idea behind Apache Beam, is a generic model that deals with both streaming and batch including windowing with...