Install Avro for Ubuntu 18.04 LTS

Avro is a phonetic keyboard for Unicode Bangla typing. For a windows machine Avro has its executable files and the installation process is pretty straight forward. However, the installation process for a Linux machine is not as simple (at least if compared to an Windows machine installation process). I am a Ubuntu user. As I am upgrading from 16.04 LTS to 18.04 LTS, I need to reinstall Avro, and seems like the installation process is a little different (as always). In this article, I am documenting the whole process for future reference (mostly for myself).

Step 1

From the search option in Ubuntu, we need to search for Language Support as shown in the following figure.

Continue reading “Install Avro for Ubuntu 18.04 LTS”

Setting up Jupyter notebook with Tensorflow, Keras and Pytorch for Deep Learning

I was trying to set up my Jupyter notebook to work on some deep learning problem (some image classification on MNIST and imagenet dataset) on my laptop (Ubuntu 16.04 LTS). Previously I have used a little bit of Keras (which runs on top of Tensorflow) on a small dataset, but I did not use that with Jupyter. For that purpose I installed Tensorflow and Keras independently and used them in a Python script. However, it was not working from my Jupyter notebook. I googled for the solution, but found nothing concrete. I tried to activate the tensorflow environment and run jupyter notebook from their but in vein. I guess the reason is, I have downloaded different packages in different times and that might make some compatibility issues. Therefore, I decided to create a BRAND NEW conda environment for my deep learning endeavor. This is how it goes:
Continue reading “Setting up Jupyter notebook with Tensorflow, Keras and Pytorch for Deep Learning”

Printing Jupyter Notebook to other File Format

As a data scientist, I frequently use Jupyter notebook. For writing some report one might need to print out (on paper) the full notebook. There is a print preview option in the current version of Jupyter notebook, but no print option.

I tried to use CTRL + P command on the print preview page, but the output was horrible (like when we try to print an webpage). I googled and found a better way of doing that.

I am running Jupyter notebook on Ubuntu 16.04. The steps are very simple:

(1) Open terminal
(2) Change directory (where the notebook is located)
(3) Use command: ipython nbconvert –to pdf A1.ipynb (A1.ipynb is my notebook)

shanto@shanto:~$ cd ~/Desktop/BigData/706/Assignments/
shanto@shanto:~/Desktop/BigData/706/Assignments$ ls
shanto@shanto:~/Desktop/BigData/706/Assignments$ jupyter nbconvert --to pdf A1.ipynb
[NbConvertApp] Converting notebook A1.ipynb to pdf
[NbConvertApp] Writing 25564 bytes to notebook.tex
[NbConvertApp] Building PDF
[NbConvertApp] Running xelatex 3 times: ['xelatex', 'notebook.tex']
[NbConvertApp] Running bibtex 1 time: ['bibtex', 'notebook']
[NbConvertApp] WARNING | bibtex had problems, most likely because there were no citations
[NbConvertApp] PDF successfully created
[NbConvertApp] Writing 23494 bytes to A1.pdf

The figure shows a snap of the generated *.pdf file. The file is reasonably neat with a good formating.

If we change the –to pdf part to –to whateverFormat then the same command can be used to convert the notebook to other formats. Conversion to a few other format is shown below.

shanto@shanto:~/Desktop/BigData/706/Assignments$ jupyter nbconvert --to script A1.ipynb
[NbConvertApp] Converting notebook A1.ipynb to script
[NbConvertApp] Writing 2077 bytes to
shanto@shanto:~/Desktop/BigData/706/Assignments$ # convert to latex
shanto@shanto:~/Desktop/BigData/706/Assignments$ jupyter nbconvert --to latex A1.ipynb
[NbConvertApp] Converting notebook A1.ipynb to latex
[NbConvertApp] Writing 25564 bytes to A1.tex

Running Spark on Local Machine

Apache Spark is a fast and general-purpose cluster computing system. To get maximum potential out of it, Spark should be running on a distributed computing system. However, one might not have access to any distributed system all the time. Specially, for learning purpose one might want tor run spark on his/her own computer. This is actually a very easy task to do. There is a handful of way to do this. I would show, what I have done to run Spark on my laptop.
Continue reading “Running Spark on Local Machine”

Ubuntu Resolution Problem for Extended Monitor

Who does not use an external monitor while using a laptop? I don’t need to know the names. But I can assure you, I certainly do. I also have to frequently switch between operating systems (for using different sets of softwares. Yes, I know VM works fine, but I just like to have things neat), specially Windows and Linux (Ubuntu). Right now I am using Windows 10 and Ubuntu 16.04 on my Lenovo X230T. When I connect an external monitor to my laptop it works perfectly fine for the Windows but in case of Ubuntu i can not set the maximum resolution for my extended monitor (which is 1920 X 1080). I just don’t see the option 1920 X 1080 there, when I connect my external monitor while running Ubuntu 16.04 (I had the same problem for Ubuntu 14.04). What I expect to see is this (this is a screen-shot taken after the troubleshooting):
Continue reading “Ubuntu Resolution Problem for Extended Monitor”