The Future of Database Technology Mark Townsend Vice President, Database Product Management
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remain at the sole discretion of Oracle.
Agenda • • • • •
Database Update Information Appliance Initiative Information Lifecycle Management Security and Compliance What’s Next – Change Assurance
Uptake (TAR Analysis) Oracle Database 10g
Oracle9i
Oracle8i
Oracle8 and Earlier
100%
7%
90% 80% 70%
44%
60% 50% 40% 30% 20%
48%
10% 0%
Sep-06
Jun-06
Mar-06
Dec-05
Sep-05
Jun-05
Mar-05
Dec-04
Sep-04
Jun-04
Mar-04
Dec-03
Sep-03
Jun-03
Mar-03
Dec-02
Sep-02
Jun-02
Mar-02
Dec-01
Sep-01
Jun-01
Mar-01
Source: TAR Analysis (October 2006)
Oracle’s 10g Grid Strategy • Enable Grid Computing • Using Low Cost Servers and Storage
• With Intelligent Software • Database Servers and Fusion Middleware
• And Automated Management Tools • Reducing Errors and Lowering Costs
• To Modernize I/T Infrastructure • Highest QoS and Flexibility, Lower Cost
Oracle 10g Grid Application Server Clusters
Real Application Clusters
Automatic Storage Management
Grid Control
Amazon Data Warehouse Modular Architecture using Oracle Database 10g RAC and ASM on Linux Amazon’s RAC is so cost-effective they run 2 concurrently and still save money. 1. Extract from source systems
2. Integrate, transform, and denormalize
3. Query and analyze
8 nodes x 4CPUs 12 TB+ STAGE
16nodes x 4CPUs 65 TB QUERY
Extract Servers
ETL Manager
2nd pair of identical RAC clusters means ‘no need for backup’ for active online data
4. Data access and publishing
Emerging Trends for DW • Data warehouses have become ubiquitous parts of the IT infrastructure • Problem: Data warehouse system configurations are easy to get wrong • Goal: Make it easy to deliver • • • •
A scalable system With reduced implementation times Eliminated deployment risks Lower cost
DW Configuration Problem: I/O An unbalanced configuration
100% Possible Efficiency
Database CPUs Memory Actuators LUNs Disks Raid
< 50% Achieved Efficiency
A balanced configuration
100% Possible Efficiency
Database CPUs Memory Actuators LUNs Disks Raid
100% Achieved Efficiency
Oracle Information Appliance Initiative • Appliance Foundations • Information Appliances • Documented best-practice configurations for data warehousing • For customers requiring flexibility and choice • Benefits: • High performance • Simple to scale: modular building blocks • Built on Oracle database and standard hardware
• Available today with HP, IBM, and EMC
• Scalable systems pre-installed and pre-configured: ready to run out-ofthe-box • For customers looking for the simplest, fastest solutions • Benefits: • • • •
High performance Simple to buy Fast to implement Built on Oracle database and standard hardware
• Available today with Panta Systems • Further announcements in coming months
Information Appliance – An Example Panta 2700 Data Warehouse Appliance • 8 Blade RAC cluster • 4 AMD 2.2Ghz dual core processors per blade • 8 GB memory per processor • Total of 64 cores and 256 GB memory
• 96 TB database storage • 532 disk drives • 250GB SATA 7200 RPM / drive
• 2 Silverstorm 9024 Infiniband Switches • Up to 12 GB / sec I/O throughput observed in database processing • Oracle Database 10g with RAC and Partitioning • Red Hat Enterprise Linux Advanced Server 4 Update 3
Information Appliance: New 1TB TPC-H Announced • The system: • Oracle Database 10g Release 2 with Real Application Clusters and Partitioning • 8-node PANTAmatrix (aka Panta 2700 Data Warehouse Appliance) • Red Hat Enterprise Linux Advanced Server 4 Update 3
• The results: • Performance: • Price-performance:
59,353.9 QphH@1000GB $24.94 $/QphH@1000GB
• Compelling combination of performance and priceperformance: • #2 in absolute performance • #2 in price-performance
As of October 23, 2006: PANTA Systems PANTAmatrix, 59,353.9QphH@1000GB, $24.94/QphH@1000GB, available 4/15/07. Source: Transaction Processing Performance Council (TPC), www.tpc.org
Information Appliance: Significant Cost Savings • An Oracle-based appliance delivers: PANTA 2700
8250z 1)
# Racks
3
2
Disks
532 spindles (250GB each)
224 spindles (150GB each)
HW/SW Costs
$1,152,429
$1,560,000
3 Yr Maintenance
$1,019,140
$842,000
Total 3YR Cost of Ownership
$2,171,569
$2,402,000
1)
• High performance out-of-thebox • Re-usable, general-purpose software and hardware • Leading support for the full breadth of applications • Enterprise-level security and availability • Leverages existing resources and expertise • Lower costs
Netezza, 2006 Whitepaper “How the Simplicity of the NPS Data Warehouse Appliance Lowers TCO”
Business Requirement – ILM (Information Lifecycle Management) • Reduce cost to retain data • Vast amounts of data are retained by enterprises for business and regulatory reasons • Need to optimize the cost of retaining data in the database to avoid skyrocketing costs
Active Data
Less Active Data
Historical Data
Typical Database Implementation without ILM Active
Data Lifecycle Less Historical Active
Archive
DIGITAL DATA STORAGE
High Performance Storage Tier
Tape Archive
Storage Sample Device Costs Storage Tier Vendor High End
Low End
min $/GB
max$/GB
EMC DMX 1000 73GB, <6TB
$26.90
$34.10
HP XP128 73GB, < 6TB
$18.90
$23.90
IBM DS8300 73GB, <6TB
$22.80
$28.80
EMC CX500 146GB, <4TB
$8.20
$10.40
HP EVA 3000 146GB, <4TB
$7.00
$8.90
IBM DS4300 146GB, <4TB
$5.90
$7.50
$29.00
$7.00
• Prices in high end range typically represent a system configured for performance • Prices in the low end range typically represent a system configured for capacity
Solution: Match Storage to Lifecycle Optimize Cost Active
Data Lifecycle Less Historical Active
Offline Archive
DIGITAL DATA STORAGE
High Performance Storage Tier
Low Cost Storage Tier
Online Archive Storage Tier
Offline Archive
The Oracle Database with Partitioning is Ideal for implementing ILM
Database + Partitioning
Active
Less Active
Historical
• • • • • • •
Understands Business Data Hardware Independent Application Transparent Fine Grained – Partitioning Customizable Central Point of Control Low Cost – Use ASM to manage multiple storage tiers
Storage
ILM Assistant
Database Features for ILM Oracle Database 10g
Oracle Database 11g adds
• Partition, Table Level Compression • Range, List and Hash Partitioning • Composite Partitioning
• Enhanced Table, Partition, LOB Compression • New Interval, Ref and Virtual Column Partitioning • New Composite Partitioning
• Range List, Range Hash
• Range Range, List Range, List List, List Hash
What a year it has been – New Product Releases • Jan’06: • Feb’06: • Mar’06: • • • •
Apr’06: May’06 Jul’06 Aug’06
Oracle Application Express Oracle Database Express Edition Oracle SQL Developer Secure Enterprise Search Oracle Secure Backup Oracle Warehouse Builder Oracle Developer Tools for .NET Oracle Content Database Oracle Records Database Oracle Database Vault
Drivers for Compliance & Security
Regulatory Compliance • SOX, Basel II, HIPAA, J-SOX, GLB, Privacy laws • Adequate IT controls • Separation of Duty • Proof of compliance • Risk assessment and monitoring
Insider Threats and Theft • 80% of threats come from insiders • 65% of internal threats are undetected • 50% customers looking at monitoring insider/DBA threats
Database Security and Compliance Products
Label Security
Advanced Security
Data Classification
Encrypted Data
Database Security and Compliance Products
Audit Vault
Database Vault
Label Security
Monitor, Alert, Multi-factor Data Consolidate DBA Controls Classification
Beta
Advanced Security
Secure Backup
Secure Search
Encrypted Data
Encrypted Data on Tape
Authorized Search
Database Vault and Audit Vault Demonstration
What is the next big challenge ?
Alfred North Whitehead: Principia Mathematica “The art of progress is to preserve order amid change and to preserve change amid order.”
Oracle Database 11g will focus on helping you preserve order amid change
New Change Assurance Capabilities in Oracle Database 11g Detect & Tune Performance Changes
Set Up Test Environments
Capture & Replay Workload
Package Incidents for Support
Online Hot Patching
Workload Capture and Replay -
Beta
Database Replay • Database Capture
Rec
• Records DB production workload including critical concurrency characteristics
• Database Replay • Replays workload with actual timing
Record & Replay
• Analysis & Reporting • • • •
Error reporting Data divergence Performance divergence ADDM for further performance analysis
Analysis & Reporting
Workload Capture and Replay –
Beta
SQL Replay • Focus on impacts on SQL query workload • Fine-grain performance analysis on individual SQL
• Captures SQL Workload in Production • Captures SQL text, plans, bind variables, execution statistics • Over specified period • Can capture Oracle Database 10g Release 2 SQL workload
• Replays SQL Workload in Test • Test executes SQL on test system • Identifies SQL with different plans and SQL with slower performance • For regressed SQL, use SQL Tuning Advisor (10g) to tune • Produces analysis & reports
Works with Standby Databases
CAPTURE
Production Database
Re c
Redo Shipment and Apply
Oracle Confidential
Beta
REPLAY Test Database
Set up Test Environments using Snapshot Standbys •
Physical Standby Apply Logs Open Database
Beta
Convert Physical Standby to Snapshot Standby and open for writes by testing applications • ALTER DATABASE CONVERT TO SNAPSHOT STANDBY;
Back out • Changes
Discard testing writes and catch-up to primary by applying logs • ALTER DATABASE CONVERT TO PHYSICAL STANDBY;
Snapshot Standby Perform Testing
• •
Preserves zero data loss Can Replay Workload against
Rolling Database Upgrades Using Transient Logical Standby Physical Logical Upgrade
• Logical standby allows rolling upgrades but has data type restrictions • Temporarily convert physical standby to logical to perform a rolling upgrade • Data type restrictions are limited to short upgrade window
• No need for separate logical standby for upgrade
Physical Also possible in 10.2 with more manual steps
SQL Replay Evaluate Impact of Database Change on SQL Performance Make Change
Pre-Change Environment
Replay Production SQL and Gather Stats
Tune SQL
Post-Change Environment
Replay SQL
Tuned Environment
SQL Tuning Advisor Replay SQL
Compare Performance
SQL Replay Demonstration
Beta
Online Table & Index Redefinition • All index changes can be done online • Create new index, move index, defragment index
• Tables can be Reorganized & Redefined online • Table contents are copied to a new table • Defragments and allows changing location, table type, partitioning • Contents can be transformed as they are copied • Can change columns, types, sizes - specified using SQL “Select”
Source Table
Continuous Queries & Updates
Copy Table
Update Tracking
Transform Result Table Store Updates
Transform Updates
GUI interface to make it Simple
Online Application Upgrade
Beta
• Large, mission critical applications are often unavailable for tens of hours while an upgrade is installed • Oracle Database 11g introduces revolutionary new capabilities that allow online application upgrade with continuous availability of the application • The pre-upgrade application and the post-upgrade application can be used at the same time • Each end-user session is rolled over on its own schedule
Online Application Upgrade Demo
How do we do it? • Oracle Database 11g brings the Edition, the Editioning View, and the CrossEdition Trigger • Code changes are installed in the privacy of a new edition. • Data changes are made safely by writing only to new columns or new tables not seen by the old Edition • An Editioning View exposes a different projection of a table into each edition to allow each to see just its own columns • A CrossEdition trigger propagates data changes made by the old edition into the new edition’s columns, or (in hotrollover) vice-versa
Sometimes you still need to log a TAR
### This is a critical production system ### = YES ACTION PLAN ============ 1. Upload trace files from both nodes. 2. Any trace file created on the background_dump_dest since the time of the problem. 3. Hanganalyze trace and system state dump from the instance that is running …. The customer :XYZ : has uploaded the following file via MetaLink: …. The customer : XYZ : has uploaded the following file via MetaLink: …. ….
ACTION PLAN ============ 1. I could not find between the trace files lmon trace, smon, pmon etc. Please upoload any trace file created on the background directory from any of the nodes today. …. The customer :XYZ : has uploaded the following file via MetaLink: …. The customer : XYZ : has uploaded the following file via MetaLink: …. …. ACTION PLAN ============ 1. Please upload the lmon,lms,lck,lmd traces for RAC and all trace files for all bg process 2. Please upload OS logs and sun Cluster dlm logs The customer :XYZ : has uploaded the following file via MetaLink: …. The customer : XYZ : has uploaded the following file via MetaLink: …. ….
Automatic Diagnostic Workflow Reduce Time to Problem Resolution
Beta
Automatic Diagnostic Repository
Critical Error
2
1 y Incident Packaging Service y First-failure Capture
3 y Alert DBA y Targeted assessments y Assisted SR Filing
CCR Collector
5
Auto Bug Matching (post 11gR1)
No
Duplicate Bug? 4
EM Support Workbench: y Package Incident information including CCR info y Guided Repair
Oracle Confidential
Yes EM Support Workbench: y Apply Patch or Workaround y Guided Repair
Support for Online Hot Patching • Oracle already supports rolling patches between nodes in a cluster • The next major release adds online patching of a running Oracle executable (single instance or cluster) with no downtime • Integrated with OPatch • Many one-off patches can be hot patched • Great for diagnostic patches
Beta
Other Oracle Database 11g Highlights • High Availability • Flashback Archive • Flashback Transaction
• Performance and Scalability • • • •
RAC Scalability Enhancements Query Result Cache Partition Advisor I/O Resource Management
• Security • Tablespace and LOB Encryption
• Business Intelligence • Next generation OLAP • Supermodels for Data Mining
• Manageability and Diagnosability • • • •
Support Workbench SQL Test Case Builder ADDM for RAC Automatic Health Monitoring
• Content Management Infrastructure • • • •
Binary XML storage Enhanced XML indexing LOB’s as fast as filesystems DICOM Medical Imaging Support • Storage & Query of Semantic Content
Discussion Points • XML Publisher • Fusion Security • R2 focus – Plug and Play Clustering
The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remain at the sole discretion of Oracle.