I was trying to set up my Jupyter notebook to work on some deep learning problem (some image classification on MNIST and imagenet dataset) on my laptop (Ubuntu 16.04 LTS). Previously I have used a little bit of Keras (which runs on top of Tensorflow) on a small dataset, but I did not use that with Jupyter. For that purpose I installed Tensorflow and Keras independently and used them in a Python script. However, it was not working from my Jupyter notebook. I googled for the solution, but found nothing concrete. I tried to activate the tensorflow environment and run jupyter notebook from their but in vein. I guess the reason is, I have downloaded different packages in different times and that might make some compatibility issues. Therefore, I decided to create a BRAND NEW conda environment for my deep learning endeavor. This is how it goes:
Continue reading “Setting up Jupyter notebook with Tensorflow, Keras and Pytorch for Deep Learning”
As a data scientist, I frequently use Jupyter notebook. For writing some report one might need to print out (on paper) the full notebook. There is a print preview option in the current version of Jupyter notebook, but no print option.
I tried to use CTRL + P command on the print preview page, but the output was horrible (like when we try to print an webpage). I googled and found a better way of doing that.
I am running Jupyter notebook on Ubuntu 16.04. The steps are very simple:
(1) Open terminal
(2) Change directory (where the notebook is located)
(3) Use command: ipython nbconvert –to pdf A1.ipynb (A1.ipynb is my notebook)
shanto@shanto:~$ cd ~/Desktop/BigData/706/Assignments/
shanto@shanto:~/Desktop/BigData/706/Assignments$ jupyter nbconvert --to pdf A1.ipynb
[NbConvertApp] Converting notebook A1.ipynb to pdf
[NbConvertApp] Writing 25564 bytes to notebook.tex
[NbConvertApp] Building PDF
[NbConvertApp] Running xelatex 3 times: ['xelatex', 'notebook.tex']
[NbConvertApp] Running bibtex 1 time: ['bibtex', 'notebook']
[NbConvertApp] WARNING | bibtex had problems, most likely because there were no citations
[NbConvertApp] PDF successfully created
[NbConvertApp] Writing 23494 bytes to A1.pdf
The figure shows a snap of the generated *.pdf file. The file is reasonably neat with a good formating.
If we change the –to pdf part to –to whateverFormat then the same command can be used to convert the notebook to other formats. Conversion to a few other format is shown below.
shanto@shanto:~/Desktop/BigData/706/Assignments$ jupyter nbconvert --to script A1.ipynb
[NbConvertApp] Converting notebook A1.ipynb to script
[NbConvertApp] Writing 2077 bytes to A1.py
shanto@shanto:~/Desktop/BigData/706/Assignments$ # convert to latex
shanto@shanto:~/Desktop/BigData/706/Assignments$ jupyter nbconvert --to latex A1.ipynb
[NbConvertApp] Converting notebook A1.ipynb to latex
[NbConvertApp] Writing 25564 bytes to A1.tex
Apache Spark is a fast and general-purpose cluster computing system. To get maximum potential out of it, Spark should be running on a distributed computing system. However, one might not have access to any distributed system all the time. Specially, for learning purpose one might want tor run spark on his/her own computer. This is actually a very easy task to do. There is a handful of way to do this. I would show, what I have done to run Spark on my laptop.
Continue reading “Running Spark on Local Machine”
Who does not use an external monitor while using a laptop? I don’t need to know the names. But I can assure you, I certainly do. I also have to frequently switch between operating systems (for using different sets of softwares. Yes, I know VM works fine, but I just like to have things neat), specially Windows and Linux (Ubuntu). Right now I am using Windows 10 and Ubuntu 16.04 on my Lenovo X230T. When I connect an external monitor to my laptop it works perfectly fine for the Windows but in case of Ubuntu i can not set the maximum resolution for my extended monitor (which is 1920 X 1080). I just don’t see the option 1920 X 1080 there, when I connect my external monitor while running Ubuntu 16.04 (I had the same problem for Ubuntu 14.04). What I expect to see is this (this is a screen-shot taken after the troubleshooting):
Continue reading “Ubuntu resolution problem for extended monitor”
Despite being a non-free software Sublime Text has been enormously popular among the coding community for various reasons. Sublime Text has been one of my favorite text editors for most of the coding tasks, especially where I don’t need any specific IDE for any particular reason. Speaking for myself, I try to accommodate most of my coding task in one text editor, and that is Sublime Text. It makes me really comfortable with the text editor and let me keep one or two editor instead of five different editors and IDEs for different languages.
Continue reading “Sublime Text for Latex on Ubuntu 16.04 LTS”