Monthly Archives: May 2015

Getting Started with Spark: local / standalone

Recently one of our clients wanted to demo the ML algorithm that we’ve developed on their laptop (w/ no internet connection); so running things on a spark cluster was not an option.  Note that spark “standalone” mode refers to actually … Continue reading

Posted in Uncategorized | Leave a comment

Error:scalac: Output path is shared between: Module tests

Problem Error:scalac: Output path is shared between: Module tests, Module tests Output path is shared between: Module production, Module production Please configure separate output paths to proceed with the compilation. TIP: you can use Project Artifacts to combine compiled classes … Continue reading

Posted in Uncategorized | Leave a comment

Using GitHub project in SBT

Sbt allows you to use github as one of the dependencies.  Here is the Build.scala that does the trick: import sbt._ import Keys._ object ExampleBuild extends Build { val dependencies = Seq( “org.scalatest” % “scalatest_2.11” % “2.2.4” ) // libraryDependencies … Continue reading

Posted in Uncategorized | Leave a comment

The request’s Content-Type is not supported. Expected: application/json

Problem When issuing a POST following reposonse is provided: The request’s Content-Type is not supported. Expected: application/json Solution POSTMAN is a great app; that provides plenty of configuration options; including some typical Content-Type settings:    

Posted in Uncategorized | Leave a comment

MongoExport: Error parsing command line: too many positional options have been specified on the command line

Problem Error parsing command line: too many positional options have been specified on the command line try ‘mongoexport –help’ for more information   Solution query has to be in single quotes mongoexport …. –query ‘YOUR-QUERY’  

Posted in Uncategorized | Leave a comment

MongoDB Default Admin Password

By default mongodb doesn’t have any users.  You would need to connect it from console shell $mongo Then you can create admin user; just follow these instructions. I was using mongo express (nodejs/npm) plug in; you would need to edit … Continue reading

Posted in Uncategorized | 2 Comments

ScalaTest IntelliJ Problem

Problem For some reason Scalatest wouldn’t work in IntelliJ import org.scalatest._ would not be recognized: cannot resolve symbol scalatest Solution Downgrade sbt (0.13.8 -> 0.13.7); in build.properties: sbt.version = 0.13.7 ref: http://stackoverflow.com/questions/22845862/sbt-idea-13-cannot-resolve-symbol/30088363#30088363   keywords libraryDependencies += “org.scalatest” % “scalatest_2.11” % “2.2.1” % … Continue reading

Posted in Uncategorized | Leave a comment

Scala JSON

I wanted to have a way to automatically de/serialize scala classes to/from JSON.  The only library that does it rather effortlessly is Play JSON; as described here.   As suggested, the best way is to use the companion object. WARNING: … Continue reading

Posted in Uncategorized | Leave a comment

SNS messages didn’t get delivered to SQS

Problem SNS messages didn’t get delivered to SQS Sollution IAM permissions need to be giving as described in: http://docs.aws.amazon.com/sns/latest/dg/SendMessageToSQS.html keywords: amazon aws subscribtion queue   Searched for sns to sqs does not work 1:22pm   SNS topic not publishing to SQS – … Continue reading

Posted in Uncategorized | Leave a comment

Server access Error: sun.security.validator.ValidatorException: PKIX path building failed

Problem Server access Error: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target url=https://repo1.maven.org/maven2/org/scala-lang/scala-library/2.11.6/scala-library-2.11.6.pom Solution After quite a bit of search; found solution to a related bug here: sudo /var/lib/dpkg/info/ca-certificates-java.postinst configure   keywords: mongo … Continue reading

Posted in Uncategorized | Leave a comment