Tag: Developer tools
Optimising performance of Spark Streaming applications on AWS EMR
January 17, 2018
by Neha Kaul, Senior Consultant in our Sydney team Altis recently delivered a real-time analytics platform using Apache Spark Streaming on AWS EMR with real-time data being streamed from AWS Kinesis Streams. In this blog post we provide insights into the key optimisation techniques that were applied to improve performance. These techniques include: Data partitioning …
Part 2: Watson Conversation Entity & Dialog Design
November 1, 2017
The second in a 3 part blog series by Melbourne consultant Jeremiah Mannings Introduction This is the second part in a series of Watson Conversation API articles that aims to cover the design and development of a finance-based chatbot. To check out the first article here! In this part of the series, we are going to …
Spark on Windows 10
September 6, 2017
The third in a series of blogs from Anandraj Jagadeesan, talks us through downloading Apache Spark on Windows 10, using the new Ubuntu environment. About Spark Apache Spark is a fast and general-purpose cluster computing system. It provides high-level APIs in Java, Scala, Python and R, and an optimized engine that supports general execution graphs. It …
Installing Ubuntu Bash for Windows 10
July 6, 2017
Anandraj Jagadeesan, a Managing Consultant with Altis in Sydney, shares his experience of installing Ubuntu Bash in a Windows 10 environment. For the last few years as a big data developer I have been using a Mac at work and a Linux desktop for my personal needs. I recently started using a Windows laptop at …