classes
i523
Lessons
Changes
Fork
Site
I523 Big Data Applications and Analytics (2017)
Content
Additional Content
I523 Big Data Applications and Analytics (2016)
Overview
Syllabus
Refcards
Homework
Gitlab
Python for Big Data
Python Fingerprint Example
Refcards
4.1. Linux Shell
2.2. LaTeX
Ubuntu Development Configurations
Using SSH Keys
Homework References
1.5. Contributing
I524 Big Data and Open Source Software Projects (2017)
Preface
i524 Big Data and Open Source Software Projects (2017)
I524 Calendar
I524 Lectures
I524 Assignments
HID Assignment
Technologies
B534 Cloud Computing (2018)
Content
FAQ
What are the prerequisites for this class?
I am full time student at IUPUI. Can I take the online version?
I am a residential student at IU. Can I take the online version only?
The class is full what do I do?
Do I need to buy a textbook?
Do I need a computer to participate in this class?
Where is the official IU calendar for the Fall?
How do I ask a question?
How to write a research article on computer science?
Which bibliography manager is required for the class?
Can I use endnote or other bibliography managers?
Plagiarism test and resources related to that
How many hours will this course take to work on every week?
Is all classes material final?
What are the changes to the web page?
What lectures should I learn when?
I524: Why are you doing the papers?
I524: Why are there no homework to test me on skills such as ansible or python?
I524: Why not use chef or another DevOps framework?
I am lost?
I do not like Technology/Topic/Project/etc?
I am not able to attend the online hours
Do I need to attend the online sessions?
What are the leaning outcomes?
There are so many messages on Piazza I can not keep up.
I do not know python. What do I do?
Tips: TechList.1 homework
Citations
Spelling
Github
Rubric
Timeliness
Outdated Tech ology
Techlist 1 and Paper 1 : Pagecount
Tips to Install Virtualbox
Do I generate the SSH key on Ubuntu VM ?
Ways to run Ubuntu on Windows 10
Don’t use Anaconda
Using SSH Key for Git Push
Can I write the papers on OSX?
What is the nature of team collaboration on papers
What is the nature of team collaboration on papers
What are the due dates for assignments
What are good places to find refernce entries?
How to install Matplotlib?
How to test if your OS can install cloudmesh_client
Windows
OS X
Linux
Tips to write a Good Paper
Lessons
Cloud (under construction)
Contributing
Writing Documents
Linux
Organization
Programming
Data
Software Projects
Software Projects
IaaS
Docker Container
Ansible
Chef
Compaprison of Configuration management software
Composite Clusters (under preparation)
Dynamic deployment of arbitrary X software on VC (under preparation)
Hadoop Virtual Cluster Installation
Ubuntu Juju
MongoDB Virtual Cluster (under preparation)
OpenMPI Virtual Cluster (Under Preparation)
OpenStack Heat
Other (Under Preparation)
DevOps (under preparation)
Overview Virtual Cluster (under preparation)
Puppet
Full Message of
salt-call
Execution
SaltStack
Notebooks
Todos
General
Changelog
%%version%% (unreleased)
3.2.0 (2017-08-07)
3.1.1 (2017-02-19)
3.1.0 (2017-02-10)
3.0.9 (2017-01-30)
3.0.8 (2017-01-22)
3.0.7 (2017-01-20)
3.0.6 (2017-01-11)
3.0.5 (2017-01-11)
3.0.4 (2017-01-09)
3.0.3 (2017-01-09)
3.0.2 (2017-01-07)
3.0.1 (2017-01-06)
3.0 (2017-01-06)
Page
Lessons
Site
I523 Big Data Applications and Analytics (2017)
Content
Additional Content
I523 Big Data Applications and Analytics (2016)
Overview
Syllabus
Refcards
Homework
Gitlab
Python for Big Data
Python Fingerprint Example
Refcards
4.1. Linux Shell
2.2. LaTeX
Ubuntu Development Configurations
Using SSH Keys
Homework References
1.5. Contributing
I524 Big Data and Open Source Software Projects (2017)
Preface
i524 Big Data and Open Source Software Projects (2017)
I524 Calendar
I524 Lectures
I524 Assignments
HID Assignment
Technologies
B534 Cloud Computing (2018)
Content
FAQ
What are the prerequisites for this class?
I am full time student at IUPUI. Can I take the online version?
I am a residential student at IU. Can I take the online version only?
The class is full what do I do?
Do I need to buy a textbook?
Do I need a computer to participate in this class?
Where is the official IU calendar for the Fall?
How do I ask a question?
How to write a research article on computer science?
Which bibliography manager is required for the class?
Can I use endnote or other bibliography managers?
Plagiarism test and resources related to that
How many hours will this course take to work on every week?
Is all classes material final?
What are the changes to the web page?
What lectures should I learn when?
I524: Why are you doing the papers?
I524: Why are there no homework to test me on skills such as ansible or python?
I524: Why not use chef or another DevOps framework?
I am lost?
I do not like Technology/Topic/Project/etc?
I am not able to attend the online hours
Do I need to attend the online sessions?
What are the leaning outcomes?
There are so many messages on Piazza I can not keep up.
I do not know python. What do I do?
Tips: TechList.1 homework
Citations
Spelling
Github
Rubric
Timeliness
Outdated Tech ology
Techlist 1 and Paper 1 : Pagecount
Tips to Install Virtualbox
Do I generate the SSH key on Ubuntu VM ?
Ways to run Ubuntu on Windows 10
Don’t use Anaconda
Using SSH Key for Git Push
Can I write the papers on OSX?
What is the nature of team collaboration on papers
What is the nature of team collaboration on papers
What are the due dates for assignments
What are good places to find refernce entries?
How to install Matplotlib?
How to test if your OS can install cloudmesh_client
Windows
OS X
Linux
Tips to write a Good Paper
Lessons
Cloud (under construction)
Contributing
Writing Documents
Linux
Organization
Programming
Data
Software Projects
Software Projects
IaaS
Docker Container
Ansible
Chef
Compaprison of Configuration management software
Composite Clusters (under preparation)
Dynamic deployment of arbitrary X software on VC (under preparation)
Hadoop Virtual Cluster Installation
Ubuntu Juju
MongoDB Virtual Cluster (under preparation)
OpenMPI Virtual Cluster (Under Preparation)
OpenStack Heat
Other (Under Preparation)
DevOps (under preparation)
Overview Virtual Cluster (under preparation)
Puppet
Full Message of
salt-call
Execution
SaltStack
Notebooks
Todos
General
Changelog
%%version%% (unreleased)
3.2.0 (2017-08-07)
3.1.1 (2017-02-19)
3.1.0 (2017-02-10)
3.0.9 (2017-01-30)
3.0.8 (2017-01-22)
3.0.7 (2017-01-20)
3.0.6 (2017-01-11)
3.0.5 (2017-01-11)
3.0.4 (2017-01-09)
3.0.3 (2017-01-09)
3.0.2 (2017-01-07)
3.0.1 (2017-01-06)
3.0 (2017-01-06)
Lessons
Web Links
i523
i524
Lessons
¶
Cloud (under construction)
Chameleon Cloud
Cloudmesh Client on Ubuntu 16.04
Use only one public IP address on Chameleon cloud
FutureSystems Cloud
Singularity
Upload the key to the FutureSystem Portal
Testing your ssh key
Installing Cloudmesh Client
Hadoop
References
Contributing
1.5. Contributing
Writing Documents
2.7. Report Format
2.2. LaTeX
2.3. Bibliography Management
2.6. Basic Emacs
2.4. reStructuredText
2.5. Markdown
2.1. Communicating Research
Linux
4.1. Linux Shell
Refcards
Using SSH Keys
Ubuntu Development Configurations
4.2. Virtual Box Installation and Instructions
Organization
Exercise
Programming
Box
Build Conda package
4.4.1. Git
How to use Git in this class
4.4.2. Github
Gitlab
Octave
Additional Programming Assignments
Preview Course Examples
Pull Requests
Anaconda
Excersise
4.3.3. Interactive Python
4.3.4. Python 3 Features in Python 2
4.3.5. Statements and Strings
4.3.6. Variables
4.3.7. Data Types
4.3.8. REPL (Read Eval Print Loop)
4.3.9. Module Management
4.3.10. Date Time in Python
4.3.11. Control Statements
4.3.12. Datatypes
4.3.13. Functions
4.3.14. Classes
4.3.15. Database Access
4.3.16. Modules
4.3.17. Installing Libraries
4.3.18. Using pip to Install Packages
4.3.19. GUI
4.3.20. Formatting and Checking Python Code
4.3.21. Using autopep8
4.3.22. Further Learning
4.3.23. Writing Python 3 Compatible Code
4.3.24. Using Python on FutureSystems
4.3.25. Ecosystem
4.3.26. Resources
4.3.27. Jupyter Notebook Tutorials
4.3.28. Exercises
4.3.29. CMD5
4.3.2. Python Installation
4.3.1. Introduction to Python
Virtual Environments (on india)
Python for Big Data
cmd
Module
Python Fingerprint Example
REST with Eve
Visualization
Word Count 1: Parallel Python
Data
Datasets
Software Projects
Common Requirements
Deployment Projects
IaaS
Analytics Projects
Project Idea: World wide road kill
Project Idea: Author disambiguty problem
Software Projects
Project Objectives
Deliverable Requirements
Detail Instructions
IaaS
IaaS Clouds
IU
Docker Container
Run Docker locally on your machine
Docker Swarm cluster on FutureSystems
Ansible
Ansible I: Simplest Example
Ansible II: Roles
Ansible III: Ansible Galaxy
Ansible: Write a Playbooks for MongoDB
Ansible Assignment
Chef
Overview
Prerequisite
Description
Installation Chef
Installation of Apache Web Server
Start
chef-client
Update on Security Group
Floating IP Address Allocation
Apache Server running by Chef
Acknowledgement
Exercises
Compaprison of Configuration management software
Composite Clusters (under preparation)
Introduction and Overview
Creating a cross resource virtual cluster
Dynamic deployment of arbitrary X software on VC (under preparation)
Prerequisite
Description
Exercises
Next Step
Hadoop Virtual Cluster Installation
Cloudmesh Cluster Installation
Hadoop Cluster Installation
Advanced Topics with Hadoop
Ubuntu Juju
Prerequisite
Description
Juju Installation on FutureSystems
Testing your Setup
Configuration of Cloud Environment
Juju GUI
Exercises
Reference and Acknowledgement
MongoDB Virtual Cluster (under preparation)
Introduction and Overview
Sharded MongoDB
OpenMPI Virtual Cluster (Under Preparation)
Introduction and Overview (under preparation)
HPC Stack - MPI (under preparation)
OpenStack Heat
Overview
Prerequisite
Description
Use of OpenStack Heat on FutureSystems
Exercises
Reference
Glossary
Next Step
Other (Under Preparation)
OpenStack Heat
DevOps (under preparation)
Overview
Description
Configuration Management
Next Step
Overview Virtual Cluster (under preparation)
Virtualization
Examples of VC Running on OpenStack
Puppet
Overview
Prerequisite
Description
Installation Puppet
A Puppet Template - manifest (.pp)
Exercises
Full Message of
salt-call
Execution
SaltStack
Overview
Prerequisite
Description
Salt Installation
Salt Call
Master and Minion
Other Commands
Grains
References
Exercises