Find Communities by: Category | Product

1 2 3 Previous Next

Everything Oracle at Dell EMC

70 Posts authored by: zhaos2

Dell EMC OVCs are certified using the Oracle Validated Configurations Program. OVCs provide easier, faster, and lower-cost deployment of Oracle Linux and Oracle VM based Oracle Database solutions for customers. The program offers pre-tested, validated reference architectures - including software, hardware, storage, and network components - along with documented best practices that are certified by Oracle and published on Oracle's website.

 

Each of the OVCs will provides:

 

  • Hardware details of all the components directly tested with OVCs
  • Expanded list of compatible hardware
  • Software details of all the components directly tested with OVCs
  • Solution ID - for Dell Sales to quickly generate a quote or Bill of Materials
  • A published link to Oracle’s website that lists all the hardware and software details, including the configuration settings

 

More information can be found: Dell EMC OVC Programs for Oracle Database 12c

 

Some useful support links:

 

Dell EMC T&V programs involves testing and validating Oracle Database 12c stack that includes various pre-determined building blocks of Dell EMC products - Servers, Storage, and Switches, and Red Hat Enterprise Linux (RHEL) 7. An end-to-end stack of Servers, Storage, and Network components that are validated using the Tested and Validated (T&V) program undergo a comprehensive integration and functionality testing with Oracle databases running on a supported OS platform. This results in providing an improved performance and a highly reliable Oracle database solution to the customers which they can adopt and purchase with high level of confidence.

 

More information can be found at: Dell EMC’s website

 

Some useful supporting links:

 

Oracle Database 12c on RHEL 7.x and Oracle Linux 7.x SDL or Compatibility Matrix

Oracle Database 12c on RHEL 7 and  Oracle Linux 7.x Deployment Guide

Oracle Database 12c on RHEL 7 Deployment Automation Tool/Scripts

Oracle Database 12c on Oracle Linux 7.x  Deployment Automation Tool/Scripts

Tuesday, May 9, 2017 10:00 am – 11:30 am PST

 

Realize Workforce Transformation

 

Listen to Jeff Clarke discuss how our customers and partners are designing, building and running their businesses on Dell. VMware CEO Pat Gelsinger will then share a perspective on the next wave of innovation in mobile-cloud technology.

 

 

 

 

 

 

 

DAY 2: NEWS HIGHLIGHTS


 

Atos.PNG

Bosch.PNG

IoT NEWS: Dell Technologies announces new Internet of Things (IoT) products and partnerships to help customers simplify their IoT deployments and more quickly realize digital transformation

  • New VMware Pulse IoT Center, Dell EMC IoT Technology Advisory Services make it easier to deploy IoT
  • New IoT partnerships with Atos, Bosch and more
  • Dell EMC & VMware help found EdgeX Foundry, a Linux Foundation project to build open framework for edge computing
LEARN MORE:

IoT PRESS RELEASE  l  ATOS PRESS RELEASE VMware PRESS RELEASE

Alice Capture-sm.png

MEET ALICE: The world's first AI-based virtual advisor for women entrepreneurs; Circular Board developed in partnership with Dell and Pivotal

  • Driven by data analytics, Alice connects women entrepreneurs in real-time mentors, resources and events that help scale their businesses
  • Machine learning will predict users' needs and curate targeted content
  • Pivotal developed and deployed Alice's software in 3+months, and Pivotal technology will allow Alice to evolve
LEARN MORE:

PRESS RELEASE  l  BLOG

6 logos-1.png

IT TRANSFORMATION CUSTOMER AWARD WINNERS: Dell EMC honored six winners of 2017 IT Transformation REALIZED awards, forward-thinking customers who use our technologies and services to drive IT transformation and become digital businesses

  • These companies (see logos at left) were among their respective industry's best in modernizing infrastructure, automating service delivery & transforming operating models and organizational relationships

LEARN MORE:

PRESS RELEASE

 




Monday, May 8, 2017 10:00 am – 11:30 am PST

 

Realize Your Digital Future

 

Hear Michael Dell discuss Dell Technologies’ vision for the future followed by David Goulden, who will build on Michael’s industry viewpoint and elaborate on the specific impact of digital transformation on IT.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Dell EMC World COE Leadership Panel


On Day 1, Dell EMC World COE Leadership panel - Digital Transformation: Global Voices - was successfully held. Bob Savage (VP and GM of Ireland COE), Orna Berry (VP and GM of Israel COE), Wei Liu (VP and GM of China COE), and Sarv Saravanan (VP and GM of India COE) joined the live TV interview, to share global insights on how digital transformation is impacting customers and communities and how Dell EMC is using our technology, innovation, skilled teams and global presence to help these groups achieve success.

 

 

 

Day 1 News Highlights:

 

DELL TECHNOLOGIES CAPITAL: Ventures arm comes out of stealth mode, is investing approximately $100 million annually in promising startups with innovative technology

  • Ventures team focuses on emerging tech areas relevant to our unique family of businesses
  • DTC has actively invested in more than 70 early-stage startups to date
  • Offers startups access to resources, scale and expertise

 

LEARN MORE:

PRESS RELEASE  l  BLOG



PowerEdge 14G SERVERS: We're #1 in servers, and we're previewing new PowerEdge Servers that are the bedrock of a modern, software-defined data center; they scale with the business, automate routine tasks, proactively secure the data center

  • Enable  up to 50% more VDI users per server
  • Easy-to-use, next-gen OpenManage Enterprise console is engineered to unify system management
  • Includes new security features for enhanced protection against malicious threats

LEARN MORE:

PRESS RELEASE l BLOG


HYPERCONVERGED INFRASTRUCTURE (HCI) UPDATES: HCI portfolio updates and new cloud consumption model makes IT simpler to acquire, deploy and manage

  • VxRail Appliances 4.5: Jointly engineered with VMware; expand enterprise software & hardware options
  • VxRack FLEX supports PowerEdge servers; XC Series integrate data protection, Pivotal Cloud Foundry
  • VDI Complete Solutions: Reduce barriers to desktop and application virtualization on HCI

LEARN MORE:

PRESS RELEASE  l  VDI BLOG l  TCO vs TCA BLOG



NEW ALL-FLASH, MIDRANGE, SCALE-OUT STORAGE: Major platform additions to high-end, midrange and unstructured storage systems help customers modernize and transform IT:

  • VMAX 950F All-Flash: Up to 4x faster than nearest competitor for world's most critical workloads
  • XtremIO X2 All-Flash: 3x higher capacity, 25% better storage efficiency, 80% better response times
  • Dell EMC Unity Midrange All-Flash: up to 4x greater file system capacity, 8x increase in density; deploy in 10 mins
  • SC5020 Midrange Hybrid: up to 45% more IOPs, 2x greater capacity, market's lowest hybrid array $/GB
  • Isilon Scale-out NAS: Up to 9x the IOPs, 18x the throughput, 21x capacity of closest competitor

LEARN MORE:

PRESS RELEASE  l VMAX BLOG  l XIO BLOG  l UNITY BLOG l SC BLOG   l  ISILON BLOG


EXPANDED DATA PROTECTION: New offerings protect, back up and recover data anytime, anywhere

  • New turnkey Integrated Data Protection Appliance: Storage, protection, search & analytics in easy-to-deploy solution
  • Up to 10x faster time to protect than traditional alternatives; 20% faster performance than closest competitor
  • Industry-leading deduplication (55:1 average) for data residing both on premise and in the cloud
  • 4 models scale from 34 TB to 1 PB (including Cloud Tier) for maximum flexibility & choice

LEARN MORE:

PRESS RELEASE  l  IDPA BLOG  l  CLOUD STRATEGY BLOG


OPEN NETWORKING: Open Networking switches pair with PowerEdge 14G servers and Dell EMC Storage to form foundation for software-defined data centers

  • Dell EMC's first 25GbE Open Networking switch offers 2x throughout of 10GbE switches
  • Dell EMC's first Open Networking platform for unified storage network switching, supports 16Gb/32Gb Fibre Channel
  • New family of energy efficient, cost-effective Open Networking switches for SMBs enable workforce transformation

LEARN MORE:

PRESS RELEASE l  BLOG


SOFTWARE-DEFINED STORAGE (SDS): SDS portfolio now supports PowerEdge 14G servers, introducing new levels of performance and scalability

  • ScaleIO:
  • ECS Updates: ECS.Next enhances data protection/management & analytics; ECS Dedicated Cloud Service lets customers use ECS through hybrid cloud model
  • IsilonSD Edge: Now supports VMware ESX V6.5 and virtual storage platforms like ScaleIO and VMware vSAN

LEARN MORE:

PRESS RELEASE  l  BLOG

 



What's Tomorrow......

 

Tuesday, May 9, 2017 10:00 am – 11:30 am PST

Realize Workforce Transformation

 

Listen to Jeff Clarke discuss how our customers and partners are designing, building and running their businesses on Dell. VMware CEO Pat Gelsinger will then share a perspective on the next wave of innovation in mobile-cloud technology.

 

 

 

 

 


As we all know, the EMC World Conference held every year in May has been an important channel for the storage industry to understand EMC technology, products and solutions. This year's Dell EMC World conference will be held in Las Vegas from May 8th to 11th. This is the first time after the merger of EMC business-oriented conference, the size is greater than Dell EMC World 2016 held in Austin last year. This is the first time that all Dell Technologies' brands have come together to demonstrate the power of technology.

 

 

 

The theme of this conference is Realize (Realize Your Digital Future, to achieve your digital future). A total of more than 12,000 IT practitioners, business executives, media and analysts were invited. Based on past feedback from the participants, EMC World is absolutely rave reviews, worth the value of the tickets:

 

 

 

What are the highlights of this year's conference? Personally think that can be divided into three categories:


1. New product release

2. Keynote Speech

          Including Michael Dell, David Goulden, Diane Bryant (Intel), Jeff Clarke, Pat Gelsinger, Jeremy Burton, Chad Sakac, Jeff               Boudreau, Beth Phalen, Ashley Gorakhpurwalla, Josh Bernstein, Manuvir Das and other senior executives from Dell's brands for a           number of keynote speeches on digital transformation,

          http://www.dellemcworld.com/general-sessions.htm

3. More than 500 group discussions and lectures

          For specific schedules please visit: https://emcworldonline.com/2017/connect/search.ww


 

 

 

Running Oracle database on VxRail can be part of Software Defined Data Center (SDDC).  SDDC is simply the logical extension of server virtualization. Analogous to the way that server virtualization dramatically maximizes the deployment of computing power, the SDDC does the same for all of the resources needed to host an application, including storage, networking and security.

 

Running Oracle database applications with a software defined datacenter and VxRail hyper-converged architecture, all resources are virtualized so they can be automatically deployed, with little or no human involvement. Database applications can be operational in minutes, shortening time to value and dramatically reducing IT staff time spent on application provisioning and deployment.

 

Faster Time to Value

 

The data center today is more than just a cost center—it is viewed by business users and executives as a competitive differentiator and strategic asset. Meeting and exceeding these expectations requires an automated infrastructure that can provision resources in minutes, not weeks, so that key applications are up and running quickly—and delivering business value. In the SDDC, resources are deployed automatically from pools, speeding the time to application rollout and providing an unprecedented degree of flexibility in the data center architecture. As a result, the organization has the agility to respond quickly to changes in the marketplace—and gain competitive advantage.

 

The integration of Oracle DBaaS into Dell EMC Enterprise Hybrid Cloud fully supports Oracle users with a self-service environment. For IT, this results in an automated, repeatable process that reduces errors and improves time-to-value.

 

For the end-user to be able to request a multi-node clustered database on-demand, using the self-service portal is highly beneficial. It reduces significant time and effort otherwise required to deploy a cluster manually. The user simply makes the request and then receives an automated email with deployment details when the request is complete.

 

 

Minimize IT Spend

 

By pooling and intelligently assigning resources, the software-defined data center with VxRail maximizes the utilization of the physical infrastructure, extending the value of investments. The SDDC makes use of commodity x86 hardware (now support Dell PowerEdge), cutting capital spend and reducing on-going maintenance expenses compared to proprietary solutions. IT staff devotes less time to routine tasks, maximizing productivity. The net result is a dramatic drop in CapEx and OpEx spend—50 percent and more for some enterprises.

 

With intelligent Oracle licensing strategy and the effective isolation of virtual machines in a VMware environment, expensive Oracle applications license cost can be dramatically reduced.

 

Scalability and Performance

 

Based on VMware vSphere and VSAN software, and built with new Intel Broadwell processors, the VxRail Appliance allows you to start small and grow, scaling capacity and performance easily and non-disruptively. All-flash VxRail Appliances include efficient and in-line deduplication, compression, and erasure coding. With these enterprise-class data services VxRail delivers high performance all-flash with increased usable capacity.

 

Eliminate Vendor Lock-in

 

Today’s data center features a staggering array of custom hardware in routers, switches, storage controllers, firewalls, intrusion detection and other components. In the SDDC with VxRail, all of these functions are performed by software running on commodity x86 servers. Instead of being locked in to the vendor’s hardware, IT managers can buy commodity servers in quantity through a competitive bid process. This shift not only saves money, but also avoids situations where problems in the vendor’s manufacturing process or supply chain result in delivery delays and impact data center operations.

 

The VxRail Series integrates VMware Virtual SAN and virtualization to provide a complete Hyper-converged infrastructure.

 

VMware Virtual SAN is integrated in your VxRail Appliance to provide Software-Defined Storage (SDS).  Virtual SAN is not a VSA, but is embedded in the ESXi hypervisor kernel’s I/O data path. As a result,  Virtual SAN can deliver the higher performance with minimum CPU and memory overhead.

 

Virtual SAN pools the VxRail Appliance's internal SSDs and HDDs on the ESXi hosts to present a single datastore for all hosts in the cluster. Virtual SAN uses a highly available, distributed, object-based architecture. Virtual SAN mirrors and distributes the individual virtual disk (VMDK) across the datastore.

 

Free IT Staff for Innovation

 

The SDDC with VxRail includes a management framework with built-in intelligence to eliminate complex and brittle management scripts, enabling cloud-scale operations with less manual effort and significant cost savings.

 

The VxRail Series offers advanced features including automatic deployment, automatic scale out, fault tolerance, and diagnostic logging.

 

By integrating of Oracle DBaaS into Dell EMC Enterprise Hybrid Cloud, you can quickly and effectively provision, manage, and migrate Oracle Database 12c as a Service with ASM on Enterprise Hybrid Cloud. This includes single-instance and RAC configurations.

 

With less time spent on routine tasks, IT staff can focus on more strategic tasks that drive innovation—a key management expectation of the corporate IT function today.

 

Unmatched Efficiency and Resiliency

 

The SDDC provides a flexible and stable platform for any application, including innovative services such as high-performance computing, big data (Hadoop), and latency-sensitive applications. Provisioning and management are automated by programmable policy-based software. Changes are made and workloads balanced by adjusting the software layer rather than hardware. When a failure occurs, the management software in the SDDC automatically redirects workloads to other servers anywhere in the datacenter, minimizing service-level recovery time and avoiding outages.

 

 

More Options for High Availability and Recoverability 

 

HA solutions for Oracle databases are complex, costly, difficult to maintain, or altogether non-existent. VMware provides a lower cost, yet highly effective HA solution that is optimal for many workloads. If your DR solution is for the database only, you are missing out on DR coverage for the rest of the application stack required to make that database work. VMware encapsulates the application stack and, when coupled with proper configuration and testing of replication, provides as close to perfect recoverability as any solution can get.

 

 

Development/Test/QA Process and Flexibility

 

Developers need systems and data that are like production in every way possible. When they get quick access to production-like development environments, development time is reduced, and features are more robust on release.

 

Do you want to move your database workload from one licensed server to another? Do you want the advantages of a private, hybrid, or public cloud environment? Do you want to create live data-centers that are thousands of miles apart, and be able to swing back and forth between them? VMware virtualization, coupled with stretch storage solutions from EMC can facilitate these options.

 

The optimum environment to test on is production itself. That can be risky, however, since the production system needs to keep your organization running. VMware allows you to provide an exact copy of the production environment to the Test/QA team without impacting your critical systems.

 

Better Security

 

Not only does VMware create a minimalized attack profile with its small footprint hypervisor, but also advanced security features like Trusted Execution Technology from Intel allow virtual machines to validate security down to the chip level.

 

 

 

 

 

 

 

Reference:

 

VxRail Data Sheet

VxRail Specification Sheet

 

The VCE VxRail Series delivers virtualization, compute, and storage in a scalable, easy to manage, hyper-converged infrastructure appliance.

 

VxRail Appliance is built on Intel Xeon processor-based x86 hardware with the VxRail™ Manager software bundle, and support for other value-added software from VCE, EMC, and VMware.

 

The VxRail Manager software bundle includes the following:

 

  • VxRail Manager for deployment, configuration, and management
  • VMware vSphere, including ESXi
  • VMware vCenter Serve
  • VMware Virtual SAN for storage
  • VMware vRealize Log Insight

 

The VxRail Appliance

 

The VCE VxRail Appliance includes the appliance hardware, VxRail Manager, EMC Secure Remote

Services (ESRS), and access to qualified EMC software products.

 

The following VxRail Appliance models are available:

 

VxRail Appliance with Hybrid Nodes

 

  • VxRail 60
  • VxRail 120
  • VxRail 160
  • VxRail 200

 

VxRail Appliance with All-flash Nodes

 

  • VxRail 120F
  • VxRail 160F
  • VxRail 200F
  • VxRail 240F
  • VxRail 280F

 

 

Features

 

The VxRail Series offers advanced features including automatic deployment, automatic scale out, fault

tolerance, and diagnostic logging.

 

Automatic deployment

 

The VxRail Manager fully automates the installation and configuration of all nodes in an appliance after

you input the basic IP address information.

 

Automatic Scale-out

 

The VxRail Series provides automated scale-out functionality by detecting a new VxRail Appliance on the

network. When a new VxRail Appliance is powered on you can add it to your existing cluster or create a

new cluster, replicating the configuration, and expanding the datastore in a cluster.

 

Node failure tolerance

 

The VxRail Series supports from 0 to 3 node failures, as defined by the VSAN FTT policy.

 

The VxRail Series implements the standard Virtual SAN policy of one failure by default:

 

  • An entire node can fail and the system will continue to function.
  • Disk failure cannot affect more than one node. One SSD can fail or as many as three HDDs on the same node can fail.
  • One network port on any node can fail without affecting the node.
  • Network failover is through the virtual switch configuration in ESXi. This is automatically configured by VxRail Manager during initial setup.

 

Logging and log bundles

 

The VxRail Series provides logging and log bundles through VxRail Manager.

 

VxRail Appliance cluster expansion

 

Your VxRail Appliance cluster can be scaled in single node increments from a minimum of four nodes up

to a maximum of 32 nodes. The VxRail Manager automated installation and scale-out features make it

easy to expand your cluster as your business demands grow.

 

Each VxRail Appliance holds up to four nodes. If the number of nodes in a cluster is not a multiple of four, you will have a partially populated appliance chassis in the cluster. You can use the empty slots in the chassis for future expansion.

 

You can mix different VxRail Appliance models in the same cluster. You must adhere to the following

guidelines when deploying a mixed cluster:

 

  • All appliances in the cluster must be running VxRail Manager version 3.5 or higher.
  • First-generation appliances (sold under the VSPEX BLUE name) can be in the same cluster with VxRail Appliances, as long as they are running VxRail Manager version 3.5 or higher.
  • Appliances using 1GbE networking (VxRail 60 Appliances) cannot be used in clusters with 10GbE networking.
  • 6G hybrid nodes cannot be used in clusters with 12G all-flash nodes.

 

VxRail Appliance cluster scalability is supported to a maximum of eight appliances or 32 nodes. However, scalability to 16 appliances or 64 nodes per cluster may be allowed. You must submit a request for product qualification (RPQ) to EMC for clusters over 32 nodes.

 

Reference:

 

VxRail Data Sheet

VxRail Specification Sheet

 

 

To grow and succeed you need to differentiate yourself from your competitors. To support the business as an enabler, your IT organization must break down silos of complexity and streamline operations to keep pace with today’s on-demand business culture and users.

 

Dell EMC VxRai enables you to buy business outcomes. It accelerates and simplifies IT through standardization and automation (such as Oracle DBaaS…), allowing you to focus on:

 

•    Getting infrastructure operational as quickly as possible while leveraging existing investments and skill sets

•    Enabling (not impeding) business applications

•    Making infrastructure growth transparent to the needs of the application and users

 

VxRail is the only fully integrated, preconfigured, and tested HCI (Hyper Converged Infrastructure) appliance powered by VMware Virtual SAN and is the easiest and fastest way to extend a VMware environment. VxRail provides a simple, cost effective hyper-converged solution that solves a wide range of your challenges and supports most applications and workloads.  Dell EMC VxRail features purpose-built platforms that deliver data services, resiliency, and QoS, enabling faster, better, and simpler delivery of virtual desktops, business critical applications, and remote office infrastructure.

 

The VxRail Appliance architecture is a distributed system consisting of common modular building blocks that scale linearly from 3 to 64 nodes in a cluster. With the power of a whole Storage Area Network (SAN), it provides a simple, cost-effective hyper-converged solution that delivers multiple compute, memory, storage, network and graphics options to match any use case and cover a wide variety of applications and workloads.

 

Based on industry-leading VMware Virtual SAN and vSphere software and built with new 5th generation Intel™ Xeon™ processors, the Dell EMC VxRail Appliance allows customers to start small and grow, scaling capacity and performance easily and non-disruptively. Single-node scaling and storage capacity expansion provide a predictable, “pay-as-you-grow” approach for future growth as needed.

 

The Dell EMC VxRail Appliance comes stacked with mission-critical data services at no additional charge. Data protection technology including EMC RecoverPoint for VMs and VMware vSphere Data Protection are incorporated into the appliance, with the option of adding Data Protection Suite for VMware and Data Domain Virtual Edition (DD VE) for larger environments that require more comprehensive data protection. EMC Cloud Array also built in to seamlessly extend the Dell EMC VxRail Appliance to public and private clouds to securely expand storage capacity without limits, providing additional on demand cloud tiering included.

 

Running Oracle database applications with a software defined datacenter and VxRail hyper-converged architecture, all resources are virtualized so they can be automatically deployed, with little or no human involvement. Database applications can be operational in minutes, shortening time to value and dramatically reducing IT staff time spent on application provisioning and deployment.

 

The Dell EMC VxRail Appliance is also backed by world-class support with a single point of contact for both hardware and software, and includes Dell EMC ESRS for call home and proactive two-way remote connection for remote monitoring, diagnosis, and repair to ensure maximum availability.

 

In the next a few blogs, I will talk more about VxRail Technologies, benefits for Oracle database and the Oracle licensing strategy to save software costs.

 

Reference:

 

VxRail Data Sheet

VxRail Specification Sheet

Ransomware is rapidly gaining popularity with cybercriminals because of the opportunity to extort small sums of money from a vast number of individuals and large sums of money from mid-size and enterprise-size organizations.

 

Three widely accepted strategies for protecting a business from  ransomware attacks include prevention, containment, and recovery.  Dell EMC, a leader in backup and recovery, shows in this paper how protecting backups and executing fast restoration can safeguard the business from extortion.

 

 

 

What

7 pages backup solution overview: “Isolated Backups on Dell EMC Data Domain” 

Contents including:

  • Ransomware – Cost and payment statistics
  • Types of infection vectors and ransomware
  • Data security best practices
  • Best practices for preventing ransomware attacks
  • Protecting your backup systems
  • Data Domain isolated recovery solution
  • Building a last line of defense – what you need

When

Available immediately to general public on emc.com: Download here

Why

Conversation starter for sales and pre-sales to use with prospects.  Reference hyperlink in email or print and leave behind

Who

  • Marketing communications:  Sam Lucido and team
  • Editing and production: Dave Simmons, Judith Cuppage
  • Sponsorship: Keith Miracle

Next

  1. Supporting blog for introduction of this solution paper
  2. Supporting customer facing presentation for sales and pre-sales using for prospects

Questions

Dave Simmons, Sam Lucido

 

 

Sample Tweets

 

Dell EMC Isolated Backup Solution on Data Domain

http://www.emc.com/collateral/technical-documentation/h15740-dell-emc-ransomware-solution-sb.pdf  a last line of defense against ransomware attacks

 

Industrial leading backup and recovery solution on Dell EMC Data Domain for safeguarding the business for extortion

http://www.emc.com/collateral/technical-documentation/h15740-dell-emc-ransomware-solution-sb.pdf  a last line of defense against ransomware attacks

 

Dell EMC Isolated Backup best practices on Data Domain

http://www.emc.com/collateral/technical-documentation/h15740-dell-emc-ransomware-solution-sb.pdf

 

  Dell EMC Hadoop Big Data Solution


  Hadoop Architecture and Cluster Deployment


 

Apache Hadoop is an open-source software framework used for distributed storage and processing of very large data sets. It consists of computer clusters built from commodity hardware. All the modules in Hadoop are designed with a fundamental assumption that hardware failures are a common occurrence and should be automatically handled by the framework.

 

The core of Apache Hadoop consists of a storage part, known as Hadoop Distributed File System (HDFS), and a processing part called MapReduce. Hadoop splits files into large blocks and distributes them across nodes in a cluster. It then transfers packaged code into nodes to process the data in parallel. This approach takes advantage of data locality – nodes manipulating the data they have access to – to allow the dataset to be processed faster and more efficiently than it would be in a more conventional supercomputer architecture that relies on a parallel file system where computation and data are distributed via high-speed networking.

 

The base Apache Hadoop framework is composed of the following modules:

 

  • Hadoop Common – contains libraries and utilities needed by other Hadoop modules;
  • Hadoop Distributed File System (HDFS) – a distributed file-system that stores data on commodity machines, providing very high aggregate bandwidth across the cluster;
  • Hadoop YARN – a resource-management platform responsible for managing computing resources in clusters and using them for scheduling of users' applications; and
  • Hadoop MapReduce – an implementation of the MapReduce programming model for large scale data processing.

 

 

 

Installing a Hadoop cluster typically involves unpacking the software on all the machines in the cluster or installing it via a packaging system as appropriate for your operating system. It is important to divide up the hardware into functions.

 

Typically one machine in the cluster is designated as the NameNode and another machine the as ResourceManager, exclusively. These are the masters. Other services (such as Web App Proxy Server and MapReduce Job History server) are usually run either on dedicated hardware or on shared infrastrucutre, depending upon the load.  The rest of the machines in the cluster act as both DataNode and NodeManager. These are the slaves.

 

To configure the Hadoop cluster you will need to configure the environment in which the Hadoop daemons execute as well as the configuration parameters for the Hadoop daemons.

 

HDFS daemons are NameNode, SecondaryNameNode, and DataNode. YARN damones are ResourceManager, NodeManager, and WebAppProxy. If MapReduce is to be used, then the MapReduce Job History Server will also be running. For large installations, these are generally running on separate hosts.

 

Configuring Environment of Hadoop Daemons

 

Administrators should use the etc/hadoop/hadoop-env.sh and optionally the etc/hadoop/mapred-env.sh and etc/hadoop/yarn-env.sh scripts to do site-specific customization of the Hadoop daemons’ process environment.

 

At the very least, you must specify the JAVA_HOME so that it is correctly defined on each remote node.

 

Administrators can configure individual daemons using more configuration options.

 

Configuring the Hadoop Daemons

 

The following configuration should be performed by Administrators:

  • Configuring the etc/hadoop/core-site.xml and etc/hadoop/hdfs-site.xml for some important paremeters.
  • Configuring NameNode and DataNode
  • Configuring ResourceManager and NodeManager
  • Configuring History Server
  • Configuring MapReduce Applications
  • Configuring MapReduce JobHistory Server

 

Monitoring Health of NodeManagers

 

Hadoop provides a mechanism by which administrators can configure the NodeManager to run an administrator supplied script periodically to determine if a node is healthy or not.

 

Administrators can determine if the node is in a healthy state by performing any checks of their choice in the script. If the script detects the node to be in an unhealthy state, it must print a line to standard output beginning with the string ERROR. The NodeManager spawns the script periodically and checks its output. If the script’s output contains the string ERROR, as described above, the node’s status is reported as unhealthy and the node is black-listed by the ResourceManager. No further tasks will be assigned to this node. However, the NodeManager continues to run the script, so that if the node becomes healthy again, it will be removed from the blacklisted nodes on the ResourceManager automatically. The node’s health along with the output of the script, if it is unhealthy, is available to the administrator in the ResourceManager web interface. The time since the node was healthy is also displayed on the web interface.

 

Hadoop Rack Awareness

 

Many Hadoop components are rack-aware and take advantage of the network topology for performance and safety. Hadoop daemons obtain the rack information of the slaves in the cluster by invoking an administrator configured module. See the Rack Awareness documentation for more specific information.

 

It is highly recommended configuring rack awareness prior to starting HDFS.

 

Logging

 

Hadoop uses the Apache log4j via the Apache Commons Logging framework for logging. Edit the etc/hadoop/log4j.properties file to customize the Hadoop daemons’ logging configuration (log-formats and so on).

 

Operating the Hadoop Cluster

 

Once all the necessary configuration is complete, distribute the files to the HADOOP_CONF_DIR directory on all the machines. This should be the same directory on all machines.

 

In general, it is recommended that HDFS and YARN run as separate users. In the majority of installations, HDFS processes execute as ‘hdfs’. YARN is typically using the ‘yarn’ account.

 

Hadoop Startup


Start the HDFS NameNode with the following command on the designated node as hdfs:



Start a HDFS DataNode with the following command on each designated node as hdfs:



Start the YARN with the following command, run on the designated ResourceManager as yarn:



Hadoop Shutdown

 

Stop the NameNode with the following command, run on the designated NameNode as hdfs:



Stop the ResourceManager with the following command, run on the designated ResourceManager as yarn:



Run a script to stop a DataNode as hdfs:

 

 

For more detail help, please contact Dell-EMC Expert

 

 

Resources

Welcome to The Apache Software Foundation!

 

 

 

Follow us on Twitter:
EMCOracle.png

Tweet this document:



Click here to learn more:

store_open.png

 

facebook_button-30.pngtwitter_button-25.pngemail_button-30.pnglinkedin_button-30.png

  Dell EMC Hadoop Big Data Solution


    Simplified Hadoop DAS Environment


 

The digital transformation is causing churn, uncertainty and disruption for many business leaders, who must act as the pressure is increasing from all directions. Big data and analytics will be at the core to enable this transformation, with Hadoop being a foundational component of a big data and analytics solution stack.

 

Hortonworks is a business computer software company based in Santa Clara, California. The company focuses on the development and support of Apache Hadoop, a framework that allows for the distributed processing of large data sets across clusters of computers.

 

Hortonworks' product named Hortonworks Data Platform (HDP) includes Apache Hadoop and is used for storing, processing, and analyzing large volumes of data. The platform is designed to deal with data from many sources and formats. The platform includes various Apache Hadoop projects including the Hadoop Distributed File System, MapReduce, Pig, Hive, HBase and Zookeeper and additional components.

 

The Hortonworks Ecosystem

 

 

Comparing to commercial products, Hortonworks will provide lower initial cost based on the fact they only charge for support and don’t charge for SW license.

 

Dell EMC Hortonworks Hadoop Solution

 

Dell EMC now provide you the option to buy your Hadoop ecosystem or build it out yourself. We recognize that the upfront work to build it yourself can be time-consuming and labor intensive. One way we help is to address those challenges by providing certified Hadoop solutions and the expertise needed to accelerate your time to value.

 

This goal of faster time to value is at the heart of the Dell EMC Hortonworks Hadoop Solution. It simplifies the architecture, design, configuration and deployment of Hadoop environments. Dell EMC engineers have validated and certified Hortonworks Data Platform (HDP) 2.5 on Dell EMC PowerEdgeTM R730xd servers and Dell EMC Networking S4048ON and S3048ON, allowing your organization to build a Hadoop cluster without the guesswork. You can leverage the Dell EMC solution to streamline the front-end work, from server configuration to network setup to running HDP 2.5 on a certified solution.

 

 

Solution Use Cases for Hadoop

 

Data Discovery

 

Uses data discovery and visualization tools to gain deeper insights from new data types stored in Hadoop and existing data center investments.

 

Single View

 

Helps create a single view of the data as it uncovers value that might have been within reach, but scattered across multiple interactions, channels, groups and platforms.

 

Predictive Analytics

 

Captures, stores and processes volumes of  data streaming from connected devices and sensors that measure business. Data science and iterative machine-learning techniques  can make confident real-time recommendations that reduce costs, improve safety, and inform investments.

 

 

Why The Dell EMC Hortonworks Hadoop Solution?

 

The Dell EMC Hortonworks Hadoop Solution provides a certified architecture that gives customers confidence when deploying the Hortonworks Data Platform (HDP) on Dell EMC PowerEdge servers with Dell EMC Networking.

 

Decrease Time To Value

 

Hardware and expertise matter when building a Hadoop environment. Dell EMC does all the hard upfront work, allowing your organization to focus on delivering deeper insights and enhanced data-driven decision making.

 

Reduce the risk

 

Dell EMC helps you organization reduce this risk. We have been building Hadoop architectures since 2011. You can leverage our expertise to help fill the skills gap and build an architecture that will meet the needs of the business.

 

Leverage proven expertise

 

You can gain hands-on experience with the Dell EMC Hortonworks Hadoop Solution in a Dell EMC Customer Solution Center. These state-of-the-art technical labs enable Dell EMC customers to explore, architect, validate and build solutions, from the data center to the edge of the network, to drive toward targeted business outcomes. capabilities.

 

Enterprise Ready

 

HDP is built for enterprises. Open enterprise Hadoop provides consistent operations, with centralized management and monitoring of clusters through a single pane of glass. With HDP, security and governance is built into the platform. This ensures that security is consistently administered across data access engines.

 

 

Resources

 

Dell EMC Hortonworks Hadoop Solution

 

 

 

Follow us on Twitter:
EMCOracle.png

Tweet this document:



Click here to learn more:

store_open.png

 

facebook_button-30.pngtwitter_button-25.pngemail_button-30.pnglinkedin_button-30.png

  Why Dell EMC Enterprise Hybrid Cloud for DBaaS - Part III


How EHC 4.0 Help Enterprises to Build Up Oracle Database as a Service


 

In the Part I and Part II of this series, I briefly covered why the most of organization IT choose Hybrid Cloud as their IT-as-a Service infrastructure, compared both Public and Private Cloud, and the benefit of Hybrid Cloud, and discussed on how EHC 4.0 provide cloud services.  In this Part III I will talk about how to quickly and effectively provision, manage, and migrate Oracle Database 12c as a Service with ASM on Enterprise Hybrid Cloud 4.o. This includes single-instance and RAC configurations.

 

 

The integration of Oracle DBaaS into Enterprise Hybrid Cloud fully supports Oracle users with a self-service environment. For IT, this results in an automated, repeatable process that reduces errors and improves time-to-value.

 

For the end-user to be able to request a multi-node clustered database on-demand, using the self-service portal is highly beneficial. It reduces significant time and effort otherwise required to deploy a cluster manually. The user simply makes the request and then receives an automated email with deployment details when the request is complete.

 

This Oracle DBaaS solution has been built and validated on a number of iterations and configurations of Enterprise Hybrid Cloud . The underlying physical environment is abstracted from the application layer by virtual and software-defined components.

 

 

This solution enables the deployment of Oracle DBaaS on Enterprise Hybrid Cloud:

 

-  The Workload Pod for Oracle DBaaS improves management of Oracle licensing compliance.

 

-  Application developers and service users can self-provision Oracle DBaaS on Enterprise Hybrid Cloud as:

•    A single-instance Oracle Database with Oracle Automatic Storage Management (ASM)

•    An Oracle Database with Oracle Real Application Clusters (RAC) and ASM

      This creates an Oracle 12c Container Database (CDB) with an optional Pluggable Database (PDB) in a single-tenant configuration.

 

-  The solution allows users to perform Oracle DBaaS Day 2 Operations:

•    Add disks to Oracle ASM Disk Groups – single-instance and RAC

•    Migrate a PDB to an Oracle 12c CDB deployed on Enterprise Hybrid Cloud

•    Add and remove Oracle DBaaS monitoring

 

-  Enable monitoring of the complete Oracle DBaaS solution by using Oracle Enterprise Manager Cloud Control 12c (OEM) and VMware vRealize Operations Manager.

 

 

 

 

The new face of IT:  Database automation

 

 

Requesting an Oracle Database - Fast simple form that can be completed in minutes

 

 

 

EHC configuration for Oracle DBaaS - Key components

 

 

 

Provisioning an Oracle Database preparation - Customizable by the IT organization

 

 

 

Oracle DBaaS deployment process - behind the scenes

 

 

 

PDB migration - moving a PDB from one CDB to another

 

 

 

 

Oracle DBaaS Day 2 Operations - Database customization

 

 

 

Day 2 operations of EHC automates routine tasks - adding new ASM disk group

 

 

 

Easily add or remove OEM 12c agent - EHC automates routine tasks

 

 

 

Day 2 operations of EHC automates routine tasks - Adding vCPU & memory

 

 

 

Monitoring Oracle DBaaS

 

 

 

 

Use existing Oracle tools OEM Express 12c - No need for new tools as DBAs can use what they have today

 

 

 

Use existing Oracle tools OEM Cloud Control 12c - no need for new tools  as DBAs can use what they have today

 

 

 

vRealize operation manager - EHC management

 

 

 

Enterprise Hybrid Cloud enables customers to build an enterprise-class, multitenant, scalable platform for complete infrastructure service lifecycle management.

 

This solution incorporates the following concepts:

  • Self-service and automation
  • Multi-tenancy and secure separation
  • Workload-optimized storage
  • Security and compliance
  • Monitoring and service assurance

 


Special thanks to Sam Lucido's slides created in presentation 'Enterprise Hybrid Cloud for Oracle'.

 

 

Resources

 

Enterprise Hybrid Cloud 4.0 - Oracle Database as a Service

Introducing EMC Hybid Cloud

 

 

 

Follow us on Twitter:
EMCOracle.png

Tweet this document:



Click here to learn more:

store_open.png

 

facebook_button-30.pngtwitter_button-25.pngemail_button-30.pnglinkedin_button-30.png

 

  Dell EMC World 2016 (October 18-20 | Austin, Texas)


     Bring PowerEdge to VxRail, VxRack


 

Hyper-converged Infrastructure integrates IT components in a scalable rack or appliance allowing you to modernize your data center with simplified management, improved performance, and elastic scalability.

 

 

Dell EMC VxRail is the only fully integrated, preconfigured, and tested HCI appliance powered by VMware Virtual SANTM and is the easiest and fastest way to extend a VMware environment. VxRail provides a simple, cost effective hyper-converged solution that solves a wide range of your challenges and supports most applications and workloads.

 

 

Dell EMC VxRack System consists of hyper-converged rack-scale engineered systems, with integrated networking, to achieve the scalability and management requirements of traditional and cloud native workloads. The VxRack family is purposely designed to enable customers to quickly deploy Infrastructure-as-a-Service and/or Private Cloud architectures.

 

 

Now, Dell EMC is integrating the Dell PowerEdge servers into the VxRail and VxRack hyper-converged systems.  The VxRail and VxRack systems used servers from original design manufacturer Quanta, we will continue offering appliances with Quanta systems for those customers that may still want them. However, with the PowerEdge systems, we can offer a broader range of VxRail configurations, address more workloads and bring hyper-converged solutions to smaller customers,

 

 

These new configurations are powered by Intel's Xeon "Broadwell" chips as well as VMware's vSphere and VSAN technologies, delivering 40 percent more CPU performance for the same price and all-flash nodes that offer twice the storage of previous versions.

 

For storage-intensive workloads like data analytics and Microsoft Exchange, customers can use VxRail appliances based on the PowerEdge R730xd servers. Workloads that need graphics support can use configurations with the PowerEdge R730 systems that include GPU accelerators from Nvidia and Advanced Micro Devices.

 

In addition, Dell EMC is now offering an entry-level three-node model in a 3U (5.25-inch) form factor that can support up to 200 virtual machines and comes in at less than $45,000. It's aimed at smaller companies and remote or branch offices.

 

 

The larger VxRack System 1000 is based on PowerEdge R630 or R730xd systems that bring greater capacity and 40 percent more CPU performance without costing more money. Dell EMC is offering 20 new configurations, including all-flash offerings

 

 

 

 

Resources:

Dell EMC Brings PowerEdge Servers to VxRail, VxRack


Follow us on Twitter:
EMCOracle.png

Tweet this document:



Click here to learn more:

store_open.png

 

facebook_button-30.pngtwitter_button-25.pngemail_button-30.pnglinkedin_button-30.png

 

 

  Dell EMC World 2016 (October 18-20 | Austin, Texas)


     Let The Transformation Begin

 

Get hands-on and learn how to transform your organization from the enterprise technology leader who knows it best. Jeremy Burton, Chief Marketing Officer, Dell, shares what our customers are expecting at Dell EMC World Austin:

 

What do your customers say are their biggest challenges?

 

They don’t say it in these exact words, but I’d say it’s figuring out what they need to do to play a part in an increasingly digital world. Now, it’s not as if customers are walking into our Executive Briefing Center and saying they have no idea what to do – it’s not like that at all – many are driving a digital agenda already. But what many of our customers ask us for is how to architect these new applications, what the options are for infrastructure and best practices for transforming their IT teams. There’s also a knock-on effect on the workforce and the security posture of the organization that we can talk to, and address, as well.

 

What are the new technologies customers are most excited about?

 

From an enterprise IT standpoint, I’d say Converged and Hyper-Converged Infrastructure. Many of our customers want to move away from the work of building their own stacks of servers, networking, and storage and focus on more strategic activities that support their business. From a data center standpoint that means buying technology that makes it much simpler stand up infrastructure and deliver apps - that’s dead center for converged infrastructure. Of course Hyper-Converged is a really hot topic with customers right now – it offers the ability to start small and grow as you need, and while its mostly used for traditional workloads today, its scale-out architecture is perfectly suited for cloud-native apps as well.

 

What are you most excited to share with customers at this year’s Dell EMC World?

 

I don’t want to spoil the surprise... but, let’s just say we’ll announce new systems that take advantage of the full power and breadth of the Dell EMC portfolio in a big way. This should really raise some eyebrows – because it’s just 30 days after closing our deal - but more importantly by combing the best of the Dell and EMC portfolio’s we’re helping solve some hairy challenges our customers are facing.

 

Why should customers attend Dell EMC World this year?

 

I think I mentioned this in a blog a bit ago – but the best reason to attend is to learn! From classes to workshops to labs, for IT professionals, there’s nothing better than learning the best ways to make use of tech and then being able to get hands on with it. There will be no shortage of opportunity to do that this year. Of course, I’d be remiss not to mention Alabama Shakes, which might be reason enough to attend! Personally, I’m also excited about the F1 race on that weekend too. Only question to answer there is Rosberg or Hamilton?

 

What are your priorities for the coming year?

 

Easy one – tell our story. It will take a long time for our message to reach our customers and partners and data suggests that people need to hear something seven times before they remember it.

 

 

Resources:

 

Dell EMC World 2016 Agenda


Follow us on Twitter:
EMCOracle.png

Tweet this document:



Click here to learn more:

store_open.png

 

facebook_button-30.pngtwitter_button-25.pngemail_button-30.pnglinkedin_button-30.png

 

 

  Dell EMC World 2016 (October 18-20 | Austin, Texas)


     True Austin Style


 

Dell World, happenning in Austin Texas (October 18-20 2016) , is now Dell EMC World.  Besides the name, Dell EMC World will be bigger and better than ever, full of technical and strategy sessions, as well as a CxO event with tracks for both commercial and enterprise-sized businesses. We’ll deliver new insights across cloud, mobility, big data, IoT, security and storage—insights that you can use to transform your organization into a digital enterprise.

 

Please attend and maximize your experience in Dell EMC World.  With over 100 sessions and 30 plus hands-on labs, you'll walk away from Dell EMC World 2016 with the tools you need to transform your data center, security, workforce, and your business.

 

 

There are dark forces at work on the edges of IT. A wave of fear grips the data center. See an all-star cast come together to show off the real heroes of Dell EMC World: the incredible new products and solutions destined to defeat any IT issues they come up against. You'll see how the super-powered advancements in Converged Infrastructure, All-Flash Storage, Hybrid Cloud, Mobile, Big Data, and Security are transforming businesses in dramatic demos that will have you on the edge of your seat.

 




What Dell EMC World offer this year:

 

  • In-depth training and hands-on experience. You will be able to choose from technical and content-rich sessions and labs covering the latest innovations for cloud, mobility, big data, the Internet of Things, storage and security.
  • Product research and analysis. In the Solutions Showcase, you will interact the latest enterprise solutions in real-world environments to see how we can capitalize on the new technology.
  • Networking with industry experts and peers. You will learn strategies for achieving our top IT priorities and be able to compare notes with other IT professionals. We can leverage these contacts for advice and best practices for months to come.
  • Insight into important technology trends. Dell EMC World gathers thought leaders, subject matter experts and IT professionals in an immersive environment of keynotes, break-out sessions and hands-on labs.

 

Some Sessions for Database Workloads:

 

DSSD D5 Rack-Scale Flash Overview: Unprecedented storage performance for mission-critical workloads

MT132

Wednesday, October 19: 02:15 PM - 03:15 PM12B

 

Keep your business processing operating at peak efficiency with Dell Engineered Solutions for databases

MT13

Thursday, October 20: 09:30 AM - 10:30 AM18C

 

The impact of high performance Oracle workloads on the evolution of the enterprise data center

MT42

Thursday, October 20: 09:30 AM - 10:30 AM14

 

Some Sessions for VCE Products

 

Self-paced Lab: VCE Vision 3.4 Software for VCE Systems

HOL48

Wednesday, October 19: 11:00 AM - 05:00 PMMezzanine 7

Thursday, October 20: 08:00 AM - 10:30 AMMezzanine 7

 

Self-paced Lab: VCE VxRail 3.5 a Fully Loaded Hyper-Converged Experience

HOL49

Wednesday, October 19: 11:00 AM - 05:00 PMMezzanine 7

Thursday, October 20: 08:00 AM - 10:30 AMMezzanine 7

 

Self-paced Lab:  Unity - VMware vSphere Integration and Awareness

HOL40

Wednesday, October 19: 11:00 AM - 05:00 PMMezzanine 7

Thursday, October 20: 08:00 AM - 10:30 AMMezzanine 7

 

OpenManage Integration for VMware vCenter

HOL5

Thursday, October 20: 08:00 AM - 09:00 AMMezzanine 9

 

VxRail A Fully Loaded Hyper-Converged Experience

HOL47

Thursday, October 20: 08:00 AM - 09:00 AMMezzanine 2

 

Kick off Dell EMC World in Austin style.

 

 

Grammy award winning band, Alabama Shakes

 

Resources:

 

Dell EMC World 2016 Agenda


Follow us on Twitter:
EMCOracle.png

Tweet this document:



Click here to learn more:

store_open.png

 

facebook_button-30.pngtwitter_button-25.pngemail_button-30.pnglinkedin_button-30.png

Filter Blog

By date:
By tag: