Fall 2014 - Big Data Applications and Analytics (Info I590)

Video Syllabus

Account Application for FutureSystems

Video Length Titles of the Lessons Description of the Lessons
|video-fs-account| 16:33 min Alternative 1: Create a portal account in FutureSystems for class projects. This lesson explains you how to create a portal account which is the first step in getting access to FutureSystems. You can also view the following videos from FutureGrid as they still apply. For written materials, see section s-account-create-account. and Creating FutureSystems Accounts and Projects They are listed in Alternative 2.
|video-portal-account| |video-portal-openid| |video-portal-sshkey| |video-portal-join-proj| 5:10 min, 1:35 min, 2:39 min, 1:28 min Alternative 2: Create a portal account in FutureSystems for class projects with more details This lesson explains you how to create a portal account which is the first step in getting access to FutureSystems. See Section s-account-create-account and Creating FutureSystems Accounts and Projects.

If you attend a class the above video clips are probably sufficient. If you like to know more, please see the videos at Creating FutureSystems Accounts and Projects

Exercises

  1. Create a portal account on FutureSystems.
  2. Identify an interesting project that you can conduct on FutureSystems Cloud, HPC, or Grid resources.
  3. Apply for a FutureSystems project or join a project. See section Join a Project.
  4. Read up on what a ssh key is. See section Using SSH Keys.
  5. Upload a ssh key. Do this via https://portal.futuresystems.org/my/ssh-keys
  6. Register your OpenID in the portal (for example if you use google).
  7. Upload a 220x220 pixel portrait of yours to the portal. Do this via https://portal.futuresystems.org/my/edit
  8. Make sure you have uploaded a small Bio. Do this via https://portal.futuresystems.org/my/Contact

Cloudmesh Introduction

Video Length Titles of the Lessons Description of the Lessons
|video-fs-gentle| 28:42 min A Gentle Introduction to Cloudmesh This lesson introduces you to cloudmesh. It provides you with an overview, the motivation for cloudmesh and some functionality requirements that motivated the architecture. The lesson also includes pointers to future development of cloudmesh.
|video-fs-learning| 17:54 min An Overview about the Cloudmesh Learning Web Pages This lesson gives a short overview about the web site on which cloudmesh is hosted. It also talks a bit about the architecture.

Excersises

  1. What is bare metal provisioning?
  2. Is there a difference between the terms raining and provisioning?
  3. Identify the different usage of the term provisioning in the community. Give various concrete definitions used in the community. With links.
  4. What is a hypervisor?
  5. What is IaaS, PaaS, BMaaS?
  6. What are prominent IaaS frameworks.
  7. What are Software tools you use to conduct Big Data Analysis?
  8. If you like to become a contributor to Cloudmesh, contact laszewski@gmail.com.

Cloudmesh Setup

Video Length Titles of the Lessons Description of the Lessons
|video-cm-install| 17:15 min Alternative 1: Setup Cloudmesh on a local desktop or laptop. This lesson explains you how to setup cloudmesh on a local desktop, it will require you to install certain programs on your system. If you do not want to do that, you can use Alternative 2. See Section Quickstart on your desktop for more details.
|video-cm-openstack-setup| 32:18 min Alternative 2: Setup Cloudmesh on a virtual machine. This lesson explains you how to setup cloudmesh on a virtual machine in the IU cloud. In contrast to Alternative 1 no software needs to be installed on your computer. The video also contains a short introduction to the Web interface. See Section Quickstart for an Openstack VM for more details.

Exercises

Choose one of the deployment methods below.

  1. Install Cloudmesh on your computer (only if you like to use it on your own machine and are aware that certain programs need to be installed). See Alternative 1.
  2. Install Cloudmesh on a virtual machine. See Alternative 2

Cloudmesh Web Interface

Video Length Titles of the Lessons Description of the Lessons
|video-cm-gui| 15:30 min The Cloudmesh Web Interface A lesson on how to use the Cloudmesh Web Interface to manage resources on a Cloud. See Section Screenshots for more details.

Exercises

  1. Register a cloud (india).
  2. Refresh images, flavors and servers
  3. Start and delete a vm on india
  4. Refresh servers

Note that some features of Cloudmesh have not been activated or may not yet work. Cloudmesh is an evolving project and changes are expected.

Cloudmesh IPython Learning Server

Video Length Titles of the Lessons Description of the Lessons
|video-cm-ipython-learning| 15:30 min The Cloudmesh IPython Lerning Server A lesson on how to IPython for directly executing the notebooks contained on on the Cloudmesh learning Web pages.

Exercises

  1. Start the IPython server
  2. Print the version in IPython (locate the hello notebook)
  3. Find additinal notebooks and play with them.

Cloudmesh Command Shell Interface

Video Length Titles of the Lessons Description of the Lessons
|video-cm-shell| 11:58 min The Cloudmesh Command Shell Interface This video we will be introducing you to the cloudmesh command shell and demonstrate to you that it is very easy to start virtual machines and access them via a command terminal. The shell provides scripting or the execution of single files. It is fully integrated in a database framework leveraging mongodb.

Exercises

  1. Start and delete a virtual machine by using Cloudmesh Command Shell Interface

Cloudmesh Command Shell API

Video Length Titles of the Lessons Description of the Lessons
|video-cm-shell-api| 9:44 min The Cloudmesh Command Shell API In this video we will be introducing you to the cloudmesh command python API and demonstrate to you that it is very easy to start virtual machines and access them via ssh. However python programmer will want to use the Python API. Neverteless this isnterface is nice for quick prototyping.

Exercises

  1. Start and delete a virtual machine by using Cloudmesh Command Shell API

Cloudmesh Command Python API

Video Length Titles of the Lessons Description
|video-cm-python-api| 14:23 min The Cloudmesh Command Python API In this video we will be introducing you to the cloudmesh python API and demonstrate to you that it is very easy to start virtual machines and access them via ssh. We will be using the keys you registered earlier and introduce you to the defaults. This makes it possible to start a VM with only two parameters. We will also teach you how to create public ips and assign them to the vm.

Exercises

  1. Start and delete a virtual machine by using Cloudmesh Python API