VSLAB Projects (2017-2019)

VSLAB Projects (2017-2019)

This is a list of items that are completed or in progress.

Area

Project

Description

Planned Deliverables

Location

Start Quarter

Status

Owner (type "@" to write owner)

SAP

SAP HANA Application Workload Guidance

Project to create a VMware Validated Design for SAP.

Whitepaper:

https://www.vmware.com/content/dam/digitalmarketing/vmware/en/pdf/solutions/vmw-vsphere-virtual-saphana-application-workload-guidance-design.pdf

Blog:

https://blogs.vmware.com/apps/2017/06/awg_s4hana_part1.html

VMworld:

https://videos.vmworld.com/global/2017/videoplayer/3237

SC2

2017 Q2

Completed

Vas Mitra

Mohan Potheri

Big Data

New Architectures for Apache SPARK & Big Data

 

 

Used GlusterFS as an alternative to HDFS for Apache SPARK

Blog:

https://www.vmware.com/content/dam/digitalmarketing/vmware/en/pdf/vmw-architectures-for- apache-spark-and-big-data.pdf

VMworld:

https://videos.vmworld.com/global/2017/videoplayer/16273

 

SC2

2017 Q3

Completed

Vas Mitra

Big Data & HPC

Big Data & HPC Experts event Palo Alto

Training was conducted for Big Data and HPC Experts in US. VSLAB was used for demo and hands on exercises.

External Blog: {+}http://michaelcorey.com/blog/vmware-experts-program-big-data/+

SC2

2018 Q1

Completed

Justin Murray
Mohan Potheri

SQL & Oracle

SQL & Oracle Experts event Sydney

Training was conducted for Oracle & SQL Experts in APAC. VSLAB was used for demo and hands on exercises.

 Video:

SC2

2018 Q2

Completed

Sudhir Balasubramanian
Oleg Ulyanov
Mohan Potheri

Oracle

Oracle Security

Develop Best Practices guidelines for cloning Production Oracle Databases for test and development environments.  Ensuring that security and compliance regulations are part of the process. 

Demo: TBD Whitepaper TBD

SC2

2018 Q2  

In Progress

Marlin McNeil (Yucca Group) Victoria Whitlock (Boeing) Fred Gomez (Netapp)

Big Data

Apache Spark with DataBricks on vSphere

Validate DataBricks runtime on vSphere on premises environment. Validate solution with NFS as the storage mechanism for SPARK.

Paper: Internal Document. Awaiting DataBricks sign off

SC2

2018 Q2

Completed

Justin Murray

Big Data

Apache Spark with DataBricks on VMC and S3

Validate DataBricks runtime on vSphere on VMC environment. Validate solution with S3 as the storage mechanism for SPARK.

Paper: Internal Document. Awaiting DataBricks sign off

VMC

2018 Q2

Completed

Justin Murray

HPC

Throughput testing in VMware Cloud on AWS

The goal of the proof of concept was to validate that the VMware Cloud on AWS infrastructure is viable and performant for HPC throughput workloads. Testing was done with throughput workloads to ensure that they were functional and ran well in the environment.

Blog: High Performance Computing Scalability Testing with VMware Cloud on AWS

VMC

2018 Q2

Completed

Mohan Potheri

Michael Cui

Machine Learning

Enhanced ML Features in vSphere 6.7

Deploy a vSphere based Machine Learning environment leveraging 6.7 and NVIDIA GPU cards. Show case pause and resume use cases for ML with GPU.

Demos:

Blogs:vSphere 6.7: Suspend and Resume of GPU-attached Virtual Machines VMworld: {+}https://videos.vmworld.com/global/2018/videoplayer/22954+

SC2

2018 Q2

Completed

Mohan Potheri
Justin Murray

Big Data

Cloudera on VMware Cloud on AWS with S3

Deploy and Validate Cloudera with VMC on AWS. Leverage S3 as the data storage platform.

Blogs: How Virtualization helps Data Science and Machine Learning

 VMC

2018 Q3

Completed

Justin Murray

HPC /ML

Real World ML Use Cases on vSphere

Identify useful real world machine learning use cases. Deploy use cases in a virtualized environment leveraging NVIDIA Grid and TensorFlow.

Demos: 


Blogs:Running Common Machine Learning use cases on vSphere VMworld: https://videos.vmworld.com/global/2018/videoplayer/26185

SC2

2018 Q3

Completed

Mohan Potheri

UC Berkeley CS Students

Oracle

Oracle E-Business Suite Virtualization

Oracle E-Business Suite Hybrid Cloud Failover with the VMware Cloud on AWS

Demos: DR for Oracle EBS using VMC
Whitepaper: In Final Review
VMworld: {+}https://videos.vmworld.com/global/2018/videoplayer/18311+

SC2 VMC

2018 Q3

Completed

Dean Bolton (VLSS)

HPC /ML

Machine Learning leveraging NVIDIA GPUs with Bitfusion on VMware vSphere

Virtualization, which has a reputation of facilitating sharing of hardware resources, can also be leveraged for sharing GPUs. In this study we will look at the performance impact of sharing GPUs leveraging BitFusion.

Multi Part Blog:
Part 1 describes the solution components and the test cases. In this part we will look at the results from our testing.
In part 2 we will look at running the Machine Learning benchmark, the testing and the results.

SC2

2018 Q3

Completed

Mohan Potheri
Na Zhang

HPC /ML

Machine Learning leveraging NVIDIA GPUs with Bitfusion on VMC and AWS EC2

Replicated previous project on VMC on AWS with EC2 GPU instances

Project deemed infeasible due to latency issues on the ENI connection to EC2. Lessons learned about VMC that were conveyed to engineering.
No Collateral

SC2

2018 Q3

Completed

Mohan Potheri

Machine Learning

Using GPUs with Virtual Machines on vSphere

Studies comparing different mechanism for deploying and using GPUs with vSphere

Multi Part Blog:
Part 1 of this series presents an overview of the various options for using GPUs on vSphere
Part 2 describes the DirectPath I/O (Passthrough) mechanism for GPUs
Part 3 gives details on setting up the NVIDIA GRID technology for GPUs
Part 4 describes the technical setup process for the BitFusion FlexDirect product on vSphere. 

SC2

2018 Q3

Completed

Justin Murray

HPC

Sharing GPUs in Singularity Containers

Virtualization, which is a proven way of facilitating sharing of hardware resources, can also be leveraged for sharing GPUs.  Combining containers with vSphere virtual machines can bring together the best of both worlds.

Blogs:Sharing NVIDIA GPUs in Singularity HPC containers leveraging vSphere
Solution Brief: In Progress

SC2

2018 Q3

Completed

Mohan Potheri

HPC/GPU Accelerated Databases

Accelerating Database Analytics with GPUs and SQReam DB

Validate vSphere as a platform for GPU accelerated databases. SQReamDB with TPC-H testing

Blogs: Virtualizing SQReamDB GPU accelerated Databases Solution Brief: In Progress

SC2

2018 Q4

Completed

Mohan Potheri

Apps

Accelerating Applications with virtualized Persistent Memory

This work covers initial configuration of the PMem in vSphere and the way how different virtualized business critical applications (like SQL Server, Oracle, SAP) can profit from using the PMem.

Blogs: Accelerating applications performance with virtualized Persistent Memory

SC2

2018 Q3

Completed

Oleg Ulyanov Vas Mitra Sudhir Balasubramanian

Apps

Labs and Exercises for VMworld Bootcamps

Bootcamps were conducted as part of Pre-conference training for customers for all areas including Microsoft, HPC, Big Data & Oracle.

Blogs: VMworld 2018 US Virtualizing Applications Track – Pre-Conference Customer Boot Camps

SC2

2018 Q3

Completed

Oleg Ulyanov Vas Mitra Sudhir Balasubramanian
Justin Murray

SQL

Using Persistent Memory with a virtual Microsoft SQL Server

This project covers how an instance of Microsoft SQL Server (further referenced as SQL Server) can consume virtual NVDIMM device in vPMem

Blogs: Using Persistent memory with a virtual Microsoft SQL Server – vPMem mode

SC2

2018 Q3

Completed

Oleg Ulyanov

Oracle

Oracle and vSphere Persistent Memory (PMEM) performance studies

Deploy a solution showcasing integration between VMware PKS, Kubernetes and MongoDB Enterprise Manager.

Demos : Accelerating Oracle Performance using vSphere Persistent Memory PMEM – Demo Blogs: Oracle on vSphere Persistent Memory Instance Recovery
Paper: https://www.vmware.com/content/dam/digitalmarketing/vmware/en/pdf/techpaper/performance/pmem-vsphere67-perf.pdf

SC2

2018 Q4

Completed

Sudhir Balasubramanian

SAP

SAP HANA with Persistent Memory in vSphere 6.7

Investigate the functionality of Persistent Memory (PMEM) in vSphere 6.7 with an SAP HANA system. 

Blogs: SAP HANA with Persistent Memory on vSphere

SC2

2018 Q4

Completed

Vas Mitra

NSX

Networking for VMC configuration testing

Different network configurations and testing for hybrid cloud between VSLAB and VMC for Experts & Partners

New shared Environment  for partners and Alumni from Expert events

SC2 & VMC

2018 Q4

Completed

Oleg Ulyanov

MongoDB

MongoDB Manager integration with Kubernetes with PKS

Deploy a solution showcasing integration between VMware PKS, Kubernetes and MongoDB Enterprise Manager.

Demos:

Blogs:

Streamlined Operations for MongoDB with VMware PKS

SC2

2019 Q1

Completed

Mohan Potheri
InterraIT

Machine Learning

H20.ai platform on vSphere

Deploy and validate H20.ai ML platform on vSphere

Demos :

Blogs:

Machine Learning with H2O – the Benefits of VMware

SC2

2019 Q1

Completed

Justin Murray

Machine Learning

H20.ai platform on vSphere

Machine Learning with Apache Spark, H2O.ai & NVIDIA GPUs

Blogs:

Deploying a Machine Learning Model into Production on VMware with H20, Apache Spark and GPUs

SC2

2019 Q1

Completed

Justin Murray

Machine Learning

Leveraging VMC for Machine Learning

University students leveraging VMC infrastructure for ML

Exposure to VMware for Academia.

SC2

2019 Q1

Completed

Enrique Corro

Machine Learning

Caffe2 & PyTorch on VMware PKS

Deploy a solution showcasing integration between VMware PKS, Caffe2 and PyTorch for Deep Learning workloads

Demos: 

Blogs:https://blogs.vmware.com/apps/2019/05/k8_ml_caffe2_pytorch_1-of-2.html

SC2

2019 Q1

Completed

Mohan Potheri
InterraIT

HPC

VMware Platform features can greatly benefit HPC environments.

Show case VMware Platform Benefits such as Multi-tenancy, HA, DRS, Snapshots, etc. in HPC.

Demos:

Blogs: https://blogs.vmware.com/apps/2019/07/vmware-hpc-benefits.html

SC2

2019 Q2

Completed

Mohan Potheri

Michael Cui

Charu Chaubal

Machine Learning

Leveraging GPU sharing with data scientists for H2O.ai

Build a solution leveraging vSphere and Bitfusion for GPU sharing in virtualized H2O.ai platform.

Blogs: https://blogs.vmware.com/apps/2019/02/machine-learning-with-h2o-the-benefits-of-vmware.html

SC2

2019 Q2

Completed

Justin Murray 
Bitfusion

Machine Learning

Deploying a Machine Learning Model into Production on VMware with H2O, Apache Spark and GPUs

his article describes the various options for production deployment of ML pipelines using H2O’s tools, the JVM and the Apache Spark platform.

Blogs: hhttps://blogs.vmware.com/apps/2019/03/deploying-a-machine-learning-model-into-production-on-vmware-with-h20-apache-spark-and-gpus.html

SC2

2019 Q2

Completed

Justin Murray 
Bitfusion

Machine Learning

Machine Learning on VMware: Training a Model with H2O.ai Tools, Inference using a REST Server and Kubernetes

In this article, we explore the tools and process for

(1) Training a machine learning model on a given dataset using the H2O Driverless AI (DAI) tool, and

(2) Deploying a trained model, as part of a scoring pipeline, to a REST server for use by business applications.

Blogs: https://blogs.vmware.com/apps/2019/06/machine-learning-on-vmware-training-a-model-with-h2o-ai-tools-inference-using-a-rest-server-and-kubernetes.html

SC2

2019 Q2

Completed

Justin Murray 

SAP

Live Migration of SAP HANA 2.0 SP3 Deployed on Persistent Memory on vSphere 6.7

In this article we show an experimental deployment of a test S/4HANA system running SAP HANA 2.0 SP3 on vSphere 6.7 with persistent memory (PMEM) – this is the first version of HANA that supports PMEM and is PMEM aware.

Blogs: https://blogs.vmware.com/apps/2019/04/live-migration-of-sap-hana-2-0-sp3-deployed-on-persistent-memory-on-vsphere-6-7.html

SC2

2019 Q2

Completed

Vas Mitra

SAP BCA Workshops

Experts event Palo Alto

Training to be conducted for SAP Experts. VSLAB will be used for demo and hands on exercises.

 

SC2

2019 Q2

Completed

BCA Team

Data Science

Machine Learning with H20.ai

Machine Learning with H2O on VMware Cloud on AWS: Moving a Live Training Experiment Between Servers

Blogs: https://blogs.vmware.com/apps/2019/09/machine-learning-with-h2o-on-vmware-cloud-on-aws-moving-a-live-training-experiment-between-servers.html https://blogs.vmware.com/apps/2020/01/virtualized_drl_bitfusion.html

 

SC2

2019 Q3

Completed

Justin Murray 

HPC

Virtualized HPC Cloud Platform with UberCloud & HPE

Deploy and validate the UberCloud Container platform solution for HPC on vSphere and the HPE Apollo HW platform

Blogs: https://blogs.vmware.com/apps/2019/10/on-demand-hpc-on-vsphere-with-ubercloud.html

SC2

2019 Q3

Completed

Mohan Potheri

UberCloud (Baris Inaloz)

 

Apps

Labs and Exercises for VMworld Bootcamps

Bootcamps will be conducted as part of Pre-conference training for customers for all areas including Microsoft, HPC, Big Data & Oracle.

Application Bootcamps at VMworld 2019

SC2

2019 Q3

Completed

Oleg Ulyanov Vas Mitra Sudhir Balasubramanian
Justin Murray, Deji

VMware Cloud Foundation

Deploy VSLAB Hybrid Cloud leveraging VMware Cloud Foundation

Rebuild VMware Solutions lab from scratch by leveraging VCF. Deploy hybrid cloud with VCF on premises and VMC public cloud infrastructure.

VMworld session

SC2

2019 Q3


Completed

Mohan Potheri

Heath Johnson

Machine Learning

Distributed Machine Learning with Horovod

Deploy Horovod on vGPU and PVRDMA and create demo for VMworld!

Paper: https://blogs.vmware.com/apps/files/2019/08/Horovod_vGPU_PVRDMA_NVIDIA.pdf

Video:

SC2

2019 Q3

Completed

Mohan Potheri

Mellanox

NVIDIA

Machine Learning

End to End Machine Learning for Natural Language Processing

Showcase ML for Natural Language processing on Kubernetes training with GPU. Deploy and demonstrate inference with CPU in remote location. (Edge)

Blogs: https://blogs.vmware.com/apps/2019/10/end-to-end-machine-learning-with-natural-language-processing-for-training-and-inference-on-vsphere-part-1-of-2.html

Video:

SC2

2019 Q3

Completed

Mohan Potheri

InterraIT

SAP

Management of SAP Data Flows in the Software Defined Datacenter with vRealize Network Insight

VRNI and its use with SAP for security and network analysis

Blogs:https://blogs.vmware.com/apps/2019/10/management-of-sap-data-flows-in-the-software-defined-datacenter-with-vrealize-network-insight.html

SC2

2019 Q3

Completed

Vas Mitra

Kubernetes

Jupyter Notebook as a service

Leverage PKS Enterprise with Pure Storage Orchestrator to leverage persistent volumes and build Jupyter notebook as a service

Blogs: https://blog.purestorage.com/jupyter-flash-kubernetes/

SC2

2019 Q3


Completed

Mohan Potheri

Pure Storage

Kubernetes

Extend Kubernetes capabilities to support Bitfusion

Extend capabilities of PKS enterprise with Bitfusion driver at the Bosch node level

VMworld Session: https://videos.vmworld.com/global/2019/videoplayer/28505

SC2

2019 Q3

Completed

Mohan Potheri

Tom Hite

Kubernetes

Leveraging Singularity as Runtime for Kubernetes with PKS

Proof of concept with Singularity runtime on PKS Essentials

Blog: https://blogs.vmware.com/apps/2019/11/running-singularity-as-the-run-time-for-kubernetes-with-vmware-pks.html

SC2

2019 Q4

Completed

Mohan Potheri

Kubernetes

Distributed Machine Learning on VMware vSphere with GPUs and Kubernetes

Leveraging Horovod and vGPU for distributed ML

Blog: https://blogs.vmware.com/apps/2019/10/distributed-machine-learning-on-vmware-vsphere-with-gpus-and-kubernetes-a-webinar.html

Webinar:

SC2

2019 Q4

Completed

Mohan Potheri

Justin Murray 

 

Kubernetes

Deploying and running Kubernetes on VMC on AWS

Provide guidance for running PKS Essentials on VMC on AWS

Blog: https://blogs.vmware.com/apps/2019/11/deploying-and-running-kubernetes-on-vmware-cloud-on-aws.html

VMC Oregon

2019 Q4

Completed

Mohan Potheri

Machine Learning

 VMware Bitfusion POC images

Development of POC templates for VMware Bitfusion

 

SC2

2019 Q4

Completed

Jim Brogan

Mohan Potheri

Cloud Native

Pivotal apps on VCF and NSX-T

Validate Pivotal solution on NSX-T and VCF

ISV Validation

 

SC2

2019 Q4

Completed

Mohan Potheri

Pivotal

Cloud Native

CockroachDB on VMware SDDC

Validate CockroachDB solution on VMware SDDC

ISV Validation

 

SC2

2019 Q4

Completed

Mohan Potheri

CockroachDB

Data Science

Anaconda Enterprise on vSphere & PKS Essentials

Show case Anaconda Enterprise and its cloud native data science applications on vSphere.

Blogs:  https://blogs.vmware.com/apps/2020/01/virtualized_drl_bitfusion.html

Videos:

 

SC2

2019 Q4

Completed

Mohan Potheri

InterraIT

Oracle

Oracle Experts event DOAG Germany

Training was conducted for Oracle Experts in DOAG. VSLAB was used for demo and hands on exercises.

 Labs and Workshops

SC2

2020 Q1

Completed

Sudhir Balasubramanian

Machine Learning

PCIE Device placement and NUMA

Device locality and NUMA placement on vSphere

Blogs: https://frankdenneman.nl/2020/01/10/pcie-device-numa-node-locality/

SC2

2020 Q1

Completed

Frank Denneman

Kubernetes

Pure Storage Orchestrator with PKS

Leverage PSO for seamless kubernetes storage provisioning and management

Blogs: https://blog.purestorage.com/jupyter-flash-kubernetes/

SC2

2020 Q1

In Progress

Pure Storage

Machine Learning

Distributed Machine Learning with VMware Bitfusion