High Availbility

OS & Virtualization

Showing posts with label exadata. Show all posts
Showing posts with label exadata. Show all posts

Wednesday, August 28, 2019

Patching Exadata

Exadata Storage Servers are patched using the  patchmgr  utility.



Current image info: we gathered this info by running imageinfo -v on each node including cells

root>dcli -g /opt/oracle.SupportTools/onecommand/dbs_group -l root "imageinfo | grep 'Image version'"   --> for db nodes
root>dcli -g /opt/oracle.SupportTools/onecommand/cell_group -l root "imageinfo | grep 'Image version'"  --> for cell nodes


SSH equivalency : We checked the ssh equivalency,
dcli -g cell_group -l root 'hostname -i'

checked our exachk version using "exachk -v" and we checked if it is in the most up-to-date version..

Downloading the new Image files
downloaded and unzipped patch files should belong to root user..

Running Patchmgr Precheck
(first for Cells, then for Dbs, lastly for Infiniband Switches
 # ./patchmgr -cells cell_group -patch_check_prereq -rolling

Upgrading  Database Nodes : (must be executed from node 1 for upgrading node 2 and from node 2 for upgrading node 1,


# ./patchmgr -dbnodes dbs_group -upgrade -log_dir auto -target_version 12.2.1.1.4.171128 -iso_repo .zip   (approx: 1 hour)

--upgrading image of db node 1
# ./patchmgr -dbnodes dbs_group -upgrade -log_dir auto -target_version 12.2.1.1.4.171128 -iso_repo .zip (approx: 1 hour)
Approx Duration : 10 mins per db.

Tuesday, September 05, 2017

Exadata - tools for administration



Purpose
Command
Conduct a comprehensive Exadata health check on your Exadata Database Machine to validate your hardware, firmware,
./exachk -a
Collecting RAID Storage Information
/opt/MegaRAID/MegaCli/MegaCli64 -PDList –aALL
Administering the Storage Cell Network
ipconf –verify
Diagnosing Your InfiniBand Network
/usr/bin/ibdiagnet
/usr/sbin/ibqueryerrors.pl
InfiniBand network performance
opt/oracle.SupportTools/ibdiagtools/infinicheck
Exadata version
imageinfo
imagehistory
oswatcher
exawatcher


 

Thursday, August 31, 2017

Exadata - the key software components and their location


Directory/Executable/FilePurpose
/opt/oracleTop level directory containing Oracle storage server software
/opt/oracle.cellosDirectory containing Exadata cell software and utilities
/opt/oracle.cellos/cell.confCell configuration file
/opt/oracle.cellos/CheckHWnFWProfileUtility to validate hardware profile
/opt/oracle.cellos/ExadataDiagCollector.shUtility to collect cell diagnostics data, valuable for SRs
/opt/oracle.cellos/functions_cellosContains various Cell OS function calls
/opt/oracle.cellos/imageinfoShows current image information
/opt/oracle.cellos/imagehistoryShows image history
/opt/oracle.cellos/ipconf[.pl]Displays or configures cell network environment
/opt/oracle.cellos/isoContains kernel ISO images
/opt/oracle.cellos/make_cellboot_usb.shCreates a USB rescue image
/opt/oracle.cellos/MegaCli64MegaCLI—also in /opt/MegaRAID/MegaCli
/opt/oracle.cellos/patchDirectory for staged patches
/opt/oracle.cellos/restore_cellboot.shRestores from USB rescue image
/opt/oracle.cellos/validations_cellDirectory containing output from cell server validations
/opt/oracle.cellos/vldconfigConfigures cell validation
/opt/oracle.cellos/vldrunRuns cell validation scripts and logs to /opt/oracle.cellos/validations_cellw
/opt/oracle/cellSymlink to /opt/oracle.cell[VERSION]
/opt/oracle/cell[VERSION]Directory containing current cell software. For example, /opt/oracle/cell11.2.2.4.2_LINUX.X64_111221
/opt/oracle/cell[VERSION]/cellsrvDirectory containing cellsrv software
/opt/oracle/cell[VERSION]/cellsrv/deploy/configConfiguration deployment files for active cell image
/opt/oracle/cell[VERSION]/cellsrv/deploy/config/cellinit.oraCell initialization parameter file
/var/log/oracleDirectory containing cell server log files, alerts, and trace files
/var/log/oracle/cellosDirectory containing log and trace files for Cell Services utilities, validation framework, and cell server startup/shutdown events
/var/log/oracle/diag/asmDirectory containing log and trace files for cell storage-related events in your cell

Saturday, August 19, 2017

5 key features that empowers Oracle Exadata

5 key features that empowers this engineered system:



1. Smart Flash Cache
The Exadata Storage Server layer includes some flash storage as a hardware component, which has been implemented as a set of PCI flash cards. The main benefit of that is of course faster access than standard, disk-based access. In some cases you can order Exadata to KEEP whole table in Smart Flash Cache which speeds up database layer access with Full Table Scans. On the other hand in Write-Back mode you can empower DBWR or LGWR performance by putting written data on flash cache first, and afterwards sync it with regular hard drives, which of course is transparent to database engine.


2. Storage Indexes
It is absolutely unique to Exadata. Storage Indexes are an intelligent storage implementation. Generally speaking classic database index by it definition is created to efficiently provide a location of a certain data key. To be honest Storage Indexes in Exadata are focused on eliminating areas on storage as possible place where data might exist. Online data maps which are completely transparent for database layer are stored on the Flash Cache of Exadata Storage Servers. To make the story short, when Exadata Storage Server scans through the Storage Index and identifies the regions where predicate value falls within the MIN/MAX for the region, only for the identified regions physical I/O occurs. And as a consequence, even Full Table Scan has been planned by CBO on Database Server layer, limited I/O operations use to be proceed.


3. Smart Scans and Cell Offloading
Offloading use to be called as secret sauce of Oracle Exadata. The main concept of Offloading is to move processing from DB Nodes (Database Servers) to the intelligent storage layer. What is even more important Offloading means the reduction in the volume of data that returns to database server, which is one of the major bottlenecks in terabytes or even more bigger databases. To eliminate the time spent on transferring completely unnecessary data between storage and the database tier is the main issue that Oracle Exadata has been built to solve. Keep in mind that Offloading and Smart Scan terms could be used somewhat interchangeably.


4. Hybrid Columnar Compression
Also known as HCC, Hybrid Columnar Compression is one of the key features of Oracle Exadata, and it is only available on this engineered system. HCC format of compression will be used only when data arrives with direct path loads. There are four levels of compression QUERY LOW (LZO, 4x), QUERY HIGH (ZLIB, 6x), ARCHIVE LOW (ZLIB, 7x) and ARCHIVE HIGH (Bzip2, 12x). Keep in mind that HCC is not a good option for OLTP systems. In case of HCC mechanics, HCC store data in nontraditional format. Even data resides in Oracle blocks, with block header for every block, in HCC data storage has been organized in logical structures called compression units (CUs). Each CU consists of multiple Oracle blocks.


5. IORM
I/O Resource Manager (IORM) is a Oracle Exadata features which enriches Oracle Resource Manager from Database layer. IORM only actively manages I/O requests when needed and when Storage Server is not fully utilized, it provide data immediately. But when a disk is under heavy utilzation, Storage Server software redirects the I/O requests to the appropriate IORM queue and schedules I/O from there according to the policies defined in your IORM plans. Generally IORM policies open the way to prioritize databases on intelligent storage layer, which enable workload optimization.

Thursday, December 08, 2016

Basic Oracle Exadata administration

Basic Oracle Exadata Machine administration



Using dcli

  1. connect as oracle user
  2. create a file named mycells



     cat <<> mycells
    dbserver01
    dbserver02
    dbserver03
    dbserver04
    END




  1. Generate a ssh key pair
  2.  ssh-keygen -t rsa

  3. You have completed. Now try it.

     dcli -g mycells "cat /proc/meminfo | grep Mem"


How to check Exadata version?





[root@remote_dbacell1 ~]# imageinfo
[root@remote_dbacell1 ~]# imagehistory







How to clean exawatcher logs?

(Doc ID 1617454.1)


One-time cleanup for ExaWatcher logs:



  1.  Stop ExaWatcher

     ./ExaWatcher.sh --stop
  2. Adjust on the command line for a one-time cleanup operation ...  will remove all older ExaWatcher logs over 2GB quotaOutput showing ExaWatcherCleanup.sh execution will be written to the console.  When completed you will see something similar to:"Current size of the result directory /opt/oracle.ExaWatcher/archive/ is 2097152 after clean up. Please see /opt/oracle.ExaWatcher/log/OldFilesDeleted.log to look for the files deleted." - Use 'control C' to exit from cleanup script
     ./ExaWatcher.sh --spacelimit "spacelimit" (in MB)ex) ./ExaWatcher.sh  --spacelimit 2048 

  3. Restart ExaWatcher

      /opt/oracle.cellos/validations/bin/vldrun.pl -script oswatcher


How to change OS user password for Cell Node, Database Node , ILOM, KVM , Infiniband Switch , GigaBit Ethernet Switch and PDU on Exadata Database Machine


(Doc ID 1291766.1)



  1. set /SP/users/root password

     > dcdli -g dbs_cell_group_ilom -| root " ipmitool sunoem cli 'set /SP/users/root password=newpassword' oldpassword"










How to stop database nodes?

  1. /grid/bin/crsctl stop crs –f
  2. Shutdown oswatcher



     cd /opt/oracle/oswatcher/osw/
    /stopOSW.sh




How to power on/off sequence?

Power off sequence



  1. On Database server
    1. crsctl stop cluster
    2. shutdown –h –u now
  2. On Storage server
    1. Shutdown –h –y now
  3. Turn off Rack, network switches


Power on sequence

  1. Rack, network switches
  2. Storage server
  3. Database server


How to Shutdown Exadata storage Server?

Shutdown sequence



  1. cellcli> LIST GRIDDISK WHERE asmdeactivationoutcome != ‘Yes’
  2. cellcli> ALTER GRIDDISK ALL INACTIVE
  3. cellcli> LIST GRIDDISK WHERE STATUS !=’INACTIVE’










Startup sequence








  1.  cellcli> ALTER GRIDDISK ALL ACTIVE
  2. cellcli> LIST GRIDDISK ATTRIBUTES name,attributes











How to replacing a Damaged Physical disk?



  1. cellcli> LIST ALERTHISTORY WHERE ALERTMESSAGE LIKE “Logical drive lost.*” DETAIL
  2. Replace the physical disk
    1. ALTER PHYSICALDISK
  3. Monitor the ASM to confirm the re-addition of the disk


Replacing a damaged Flash Card





  1.  cellcli> LIST PHYSICALDISK DETAIL

  2. power off cell
  3. replace the damanged card
  4. power on the cell


Moving all disk from one cell to another






  1.  cellcli> ALTER GRIDDISK ALL INACTIVE
  2. Backup OS config
  3. Move the disk,flashcard, disk controller and CELLBOOT to new cell
  4. Boot the new cell
  5. Restart cell services



     Cellcli> ALTER CELL RESTART SERVICES ALL



  6. Activate the gird disks

     Cellcli> ALTER GRDDISK ALL ACTIVE