March 15, 2024
import sbt.{Compile, Test, *} import Keys.{baseDirectory, libraryDependencies, *} // sbt.version = 1.6.2 ThisBuild / trackInternalDependencies := TrackLevel.TrackIfMissing lazy val welcome = taskKey[Unit]("welcome") val sparkVersion = "2.4.0-cdh6.2.1" val hiveVersion = "2.1.1-cdh6.2.1" lazy val commonSettings = Seq( //organization := "com.nnz", version := "0.1.0-SNAPSHOT", welcome := { println("Welcome !")}, scalaVersion := "2.11.12", javacOptions ++= Seq("-source", "15.0.10", "-target", "15.0.10"), libraryDependencies ++= sparkDependencies, resolvers ++= Seq("Cloudera Versions" at "https://repository.cloudera.com/artifactory/cloudera-repos/", ) ) lazy val root = (project in file(".
...
October 26, 2023
Installations # Install Git - Link Install Hugo - Link Configuration # To create a new Hugo website, run: hugo new site mynewsite then cd to the directory cd mynewsite Initialize the site as a git repository git init Choose the hugo theme that suits you. Hugo offer a selection of themes developed by the community. This site for example was built using Hugo-Book.
...
June 8, 2023
Thanks to the Jupyter community, it’s now much easier to run PySpark on Jupyter using Docker. There are two ways you can do this : 1. the “direct” way and 2. the customized way.
The “direct” way # verify your local settings are aligned with the pre-requisites to run this container, grosso modo make sure docker is installed, of course ! You have to have about 4 GB of free space pull image from docker hub https://hub.
...
July 12, 2019
Comment documenter ? # Les mêmes principes et critères d’un bon code devraient s’appliquer à la documentation:
Conventionnelle Simple Facile à comprendre En plus des critères d’un bon code, une bonne documentation devrait aussi être:
Explicative (intention du code, règles métiers, clarification du code, mise en garde sur les conséquences d’une mauvaise utilisation, indications pour le testing) Non-redondante /** * Returns the temperature. */ int get_temperature(void) { return temperature; } Non-bruitée /** * Always returns true.
...