Translate

Wednesday, June 2, 2010

Oracle ASM Load Balancing

ASM Load Balancing

Anthony D. Noriega, MBA, MSCS, BSSE, OCP

Abstract
ASM brings the ability to leverage integrated volume management, usage, and hard drive access optimization beyond underlying formatting, by also reaching a minimum level of I/O contention. Understanding ASM processes, in particular RBAL, and the various strategies to attain optimization during regular operations requiring load balancing in various aspects is carefully discussed, and presented with key details, in particular adjusting the ASM Power Limit. Various scenarios involving specific command usage are introduced and clearly explained with focus on driving the best load balancing approaches and desirable outcomes, while monitoring ASM instance accordingly. Other tasks such as rolling ASM upgrades and ASM repairs are covered in relation to load balancing goals.

Background and Conceptual Framework
Both an Oracle ASM instance and an Oracle Database instance are built on the same technology. Like a database instance, an Oracle ASM instance has memory structures (System Global Area) and background processes. Besides, Oracle ASM has a minimal performance impact on a server. Rather than mounting a database, Oracle ASM instances mount disk groups to make Oracle ASM files available to database instances.

An ASM instance has two background processes, namely:
  • RBAL, which coordinates rebalance activities for disk groups.
  • ARBx, x=0,1,2..., which actually performs the balance of extents movements.
In the database instances, there are three background process to support ASM, namely:
  • RBAL, which performs global opens on all disks in the disk group.
  • ASMB, this process contact CSS using the group name and acquires the associated ASM connect string. The connect string is subsequently used to connect to the ASM instance.
  • O00x, a group slave processes, with a numeric sequence starting at 000.

Exhibit 1. ASM Global Architecture (Oracle ASM Instance with Oracle Database Instance.)

ASM and Oracle Clusterware

To share a disk group among multiple nodes, the DBA must install Oracle Clusterware on all of the nodes, regardless of whether Oracle RAC is installed on these nodes. Besides, Oracle ASM instances that are on separate nodes do not need to be part of an Oracle ASM cluster. However, if the Oracle ASM instances are not part of an Oracle ASM cluster, they cannot communicate with each other. Likewise, multiple nodes which are not part of an Oracle ASM cluster are unable to share a disk group.

Failure groups are defined for a disk group when creating an Oracle ASM disk group, after which, it is not possible to alter the redundancy level of the disk group.
Oracle ASM metadata resides within the disk group and contains information that Oracle ASM uses to control a disk group, including:
· The disks that belong to a disk group
· The filenames of the files in a disk group
· The location of disk group data file extents
· The amount of space that is available in a disk group
· A redo log recording information about atomically changing metadata blocks
· Oracle ADVM volume information
When Oracle ASM instances are clustered using Oracle Clusterware, there is one Oracle ASM instance for each cluster node. In contrast, when there are several database instances for different databases on the same node, then these database instances share the same single Oracle ASM instance.
Oracle ASM Striping
There are two primary purposes for Oracle ASM striping, namely:

· To balance loads across all of the disks in a disk group
· To reduce I/O latency
Coarse-grained striping provides load balancing for disk groups while fine-grained striping reduces latency for certain file types by spreading the load more widely.
Extents



The contents of Oracle ASM files are stored in a disk group as a collection of extents that are stored on individual disks within disk groups. Each extent resides on an individual disk. Extents consist of one or more allocation units (AU), and can use variable size to enable support for larger Oracle ASM data files, reduce SGA memory requirements for very large databases, and improve performance for file create and open operations. The initial extent size equals the disk group allocation unit size and it increases by a factor of 4 or 16 at predefined thresholds.
The extent size of a file varies as follows:
· Extent size always equals the disk group AU size for the first 20000 extent sets (0 - 19999).
· Extent size equals 4*AU size for the next 20000 extent sets (20000 - 39999).
· Extent size equals 16*AU size for the next 20000 and higher extent sets (40000+).
Initialization Parameters



The following initialization parameter file should be well known when balancing ASM load, namely:
ASM_DISKGROUPS



The ASM_DISKGROUPS is a dynamic parameter specifies a list of the names of disk groups that an Oracle ASM instance mounts at startup. In particular, Oracle ignores the value set for ASM_DISKGROUPS when specifying the NOMOUNT option at startup or when issuing the ALTER DISKGROUP ALL MOUNT statement. Besides, its default value is a NULL string.
The ASM_DISKGROUPS parameter is dynamic. When using a server parameter file (SPFILE), Oracle ASM automatically adds a disk group to this parameter when the disk group is successfully created or mounted. Similarly, Oracle ASM automatically removes a disk group from this parameter when the disk group is dropped or dismounted.

The following is an example of setting the ASM_DISKGROUPS parameter dynamically:
SQL> ALTER SYSTEM SET ASM_DISKGROUPS = ADNDATA1, ADNFRA;
When using a text initialization parameter file (PFILE), this parameter is edited in order to add the name of a disk group such that it is mounted automatically at instance startup.
The following is an example of the ASM_DISKGROUPS parameter in the initialization file:
ASM_DISKGROUPS = ADNDATA1, ADNFRA
ASM_DISKSTRING
The ASM_DISKSTRING initialization parameter specifies the comma-delimited list of strings that limits the set of disks that an Oracle ASM instance discovers. The discovery strings can include wildcard characters.
This discovery string format depends on the Oracle ASM library and the operating system that are in use.
For instance, on Linux servers that not using ASMLIB, to limit the discovery process to only include disks that are in the /dev/adndisks directory, set the ASM_DISKSTRING initialization parameter to:
/dev/adndisks/*
Oracle ASM cannot use a disk unless all of the Oracle ASM instances in the cluster can discover the disk through one of their own discovery strings, i.e., all disks must be discoverable by all of the nodes in the cluster.
ASM_POWER_LIMIT
The ASM_POWER_LIMIT initialization parameter specifies the default power for disk rebalancing. The default value is 1 and the range of allowable values is 0 to 11 inclusive. Indeed, setting a value of 0 disables rebalancing. Likewise, higher values enable the rebalancing operation to perform tasks faster, but could lead to higher I/O overhead as well.

ASM_PREFERRED_READ_FAILURE_GROUPS
The ASM_PREFERRED_READ_FAILURE_GROUPS initialization parameter value is a comma-delimited list of strings that specifies the failure groups that should be preferentially read by the given instance.

DB_CACHE_SIZE
The setting for the DB_CACHE_SIZE parameter determines the size of the buffer cache. The DB_CACHE_SIZE does not need to be set when using automatic memory management.

DIAGNOSTIC_DEST
The DIAGNOSTIC_DEST initialization parameter specifies the directory where diagnostics for an instance are located. It defaults to the $ORACLE_BASE directory for the Oracle grid infrastructure installation.

INSTANCE_TYPE



The INSTANCE_TYPE initialization parameter must be set to Oracle ASM for an Oracle ASM instance.
LARGE_POOL_SIZE
The setting for the LARGE_POOL_SIZE parameter is utilized for large allocations. In general, the default value for this parameter is suitable for most environments, e.g., 16M. This parameter is not be set when using automatic memory management (AMM).

PROCESSES



The PROCESSES initialization parameter affects Oracle ASM, but the default value is usually suitable. However, if multiple database instances are connected to an Oracle ASM instance, the following formula is quite useful:
PROCESSES = 50 + 50*N
where N is the number database instances connecting to the Oracle ASM instance.
REMOTE_LOGIN_PASSWORDFILE

The REMOTE_LOGIN_PASSWORDFILE initialization parameter specifies whether the Oracle ASM instance checks for a password file.

SHARED_POOL_SIZE



The setting for the SHARED_POOL_SIZE parameter determines the amount of memory required to manage the instance. There is no need to set this parameter when using automatic memory management.
The configuration guidelines for parameters to properly plan SGA sizing on the database instance are as follows:
· PROCESSES: Add 16 to the current or estimated database instance value
· LARGE_POOL_SIZE: Add an additional 600K to the current or estimated database instance value
· SHARED_POOL_SIZE: Add up the values from the following queries to obtain the current database storage size that is either on Oracle ASM or stored in Oracle ASM. Next, determine the redundancy type and calculate the SHARED_POOL_SIZE using the aggregated value as input.
SELECT SUM(bytes)/(1024*1024*1024) AS TOT_DATA_BYTES
FROM V$DATAFILE;
SELECT SUM(bytes)/(1024*1024*1024) AS TOT_TEMP_BYTES
FROM V$TEMPFILE
WHERE status='ONLINE';
SELECT SUM(bytes)/(1024*1024*1024) AS TOT_LOG_BYTES
FROM V$LOGFILE L1, V$LOG L2
WHERE L1.group#=L2.group#;
· When using normal redundancy disk groups, every 50 GB of space requires about 1 MB of extra shared pool plus 4 MB

· When using high redundancy disk groups, about every 33 GB of space requires about 1 MB of extra shared pool plus 6 MB

· When using external redundancy disk groups, every 100 GB of space requires about 1 MB of extra shared pool plus 2 MB.

AU_SIZE



Determines the size of the allocation unit for the disk group. For information about allocation unit size and extents query the AU_SIZE disk group attribute in the ALLOCATION_UNIT_SIZE column of the V$ASM_DISKGROUP view.
COMPATIBLE.ASM
Specifies the minimum software version for any Oracle ASM instance that uses a disk group.
COMPATIBLE.RDBMS
Specifies the minimum software version for any database instance that uses a disk group.
COMPATIBLE.ADVM



Determines whether the disk group can contain Oracle ASM volumes.
Optimizing Oracle ASM Disk Discovery
In ASM technology, disk discovery is the mechanism used to find the operating system names for disks Oracle ASM can access. Disk discovery occurs when the instance is initialized. Oracle ASM discovers and examines the contents of all of the disks that are in the paths that you designated with values in the ASM_DISKSTRING initialization parameter. Disk discovery also takes place when:
· Running the following SQL statements such as, namely:
· Mount a disk group with ALTER DISKGROUP ... MOUNT · Add a disk to a disk group with CREATE or ALTER DISKGROUP...ADD DISK
· Online a disk with ALTER DISKGROUP ... ONLINE DISK
· Resize a disk in a disk group with ALTER DISKGROUP...RESIZE DISK · Query with SELECT ... FROM V$ASM_DISKGROUP or V$ASM_DISK views
· Running Oracle Enterprise Manager or Oracle ASM Configuration Assistant (ASMCA) operations that invoke the SQL statements previously mentioned.
· Running ASMCMD commands that perform the same operations as the SQL statements as listed before.
Once Oracle ASM successfully discovers a disk, the disk appears in the V$ASM_DISK view. The disk header can have a value of MEMBER for disks that belong to a disk group; CANDIDATE or PROVISIONED for disks that were discovered, but that have not yet been assigned to a disk group; or FORMER for disks that previously belonged to a disk group and were dropped accordingly from the disk group. In Linux environments, for instance, ASMLIB API can facilitate disk discovery.
Important Disk Discovery Rules
The following rules for discovering Oracle ASM disks can affect most rebalancing operations:

· Oracle ASM can discover up to 10,000 disks.
· Oracle ASM only discovers disk partitions, excluding partitions that include the partition table.
· From the installation point of view, candidate disks are those that have the CANDIDATE, PROVISIONED, or FORMER header status, and they can be added to disk groups without using the FORCE flag.
When adding a disk, the FORCE option must be used if Oracle ASM recognizes that the disk was managed by Oracle, listed as FOREIGN in the V$ASM_DISK view. In this scenario, the FORCE keyword can be used to add the disk to a disk group.
MEMBER disks can normally be added to a disk group by specifying the FORCE flag, if the disks are not part of a currently mounted disk group.
In addition, Oracle ASM is able to identify issues such as multiple paths on the same disk, which causes the mount to fail. Besides, proper setting of the ASM_DISKSTRING parameter can lead to discovery time improvement.
ASM Maintenance and Load Balancing



Adding Disks to a Diskgroup


The following statement successfully adds disks /dev/diskA3 through /dev/diskA5 to adnata1. Since no FAILGROUP clauses are included in the ALTER DISKGROUP statement, each disk is assigned to its own failure group.
ALTER DISKGROUP adndata1 ADD DISK
'/dev/diskA3' NAME diskA3,
'/dev/diskA4' NAME diskA4,
'/dev/diskA5' NAME diskA5;



The NAMEclauses assign names to the disks, otherwise they would have been assigned system-generated names.
ALTER DISKGROUP adndata1 ADD DISK
'/dev/diskA*';
An alter diskgroup statement can fail when either a disk is already part of another diskgroup or when the search string matches disks that are already contained in other disk groups.
Similarly, the following statement would successfully add /dev/diskD1 through /dev/diskD7 to disk group adnata2. This statement runs with a rebalance power of 5, and does not return until the rebalance operation is complete.

ALTER DISKGROUP adndata2 ADD DISK
'/dev/diskD*'
REBALANCE POWER 4 WAIT;



If /dev/diskC3 was previously a member of a disk group that no longer exists, then it is possible to use the FORCE option to add the disk as a member of another disk group. The following statement illustrates this scenario. For this statement to succeed, adndata3 cannot be mounted.
ALTER DISKGROUP adndata3 ADD DISK
'/dev/diskC3' FORCE;



Managing Disk Drops from a Diskgroup


With its DROP DISK clause the ALTER DISKGROUP statement handles the task of dropping disks from a disk group. The option to drop all of the disks in specified failure groups is also possible using the DROP DISKS IN FAILGROUP clause.
In general, an important load balancing drill occurs when a disk is dropped, for which the disk group is rebalanced by moving all of the file extents from the dropped disk to other disks in the disk group. When performing both add and drop disk operations, the best approach is to perform them using the same ALTER DISKGROUP statement. Indeed, this has the benefit of rebalancing data extents only one time and emphasizing that there is enough space for the rebalance operation to succeed. In many scenarios, it is recommended to reduce the ASM_POWER_LIMIT in a commensurate fashion to leverage the overhead involved.
The ALTER DISKGROUP...DROP DISK SQL statement returns to SQL prompt before the drop and rebalance operations are complete, so the DBA must wait until the HEADER_STATUS column for this disk in the V$ASM_DISK view changes to FORMER before reusing, removing or disconnecting the dropped disk. Querying V$ASM_OPERATION view is useful to determine the amount of time remaining for the drop/rebalance operation to complete.
When specifying the FORCE clause for the drop operation, the disk is dropped even if Oracle ASM cannot read or write to the disk, and it may not be applied to drop a disk from an external redundancy disk group. Thus, a DROP FORCE operation leaves data at decreased redundancy until the subsequent rebalance operation completes. This increases the possibility of data loss if a subsequent disk failure occurs during rebalancing.
The following statements demonstrate how to drop disks from the disk group adndata1.
The following example drops diskA5 from disk group adnata1.
ALTER DISKGROUP adnata1 DROP DISK diskA5;
The following example drops diska5 from disk group adndata1, and also illustrates how multiple actions are possible with one ALTER DISKGROUP statement.
ALTER DISKGROUP adndata1 DROP DISK diskA5
ADD FAILGROUP failgroup1 DISK '/dev/diskA7' NAME diskA7;
ASM Storage Management Optimization with Intelligent Data Placement

Intelligent Data Placement enables setting disk regions on Oracle ASM disks for optimal performance, such that frequently accessed data is placed on the outermost (hot) tracks which have greater speed and higher bandwidth while files with similar access patterns are set physically close in order to reduce latency. Intelligent Data Placement also enables the placement of primary and mirror extents into different hot or cold regions.

Intelligent Data Placement settings can be specified for a file or in disk group templates. The disk region settings can be modified after the disk group has been created. The disk region setting can improve I/O performance by placing more frequently accessed data in regions furthest from the spindle, while reducing cost by increasing the usable space on a disk.
Intelligent Data Placement works best for the following:
· Databases with data files that are accessed at different rates. A database that accesses all data files in the same way is unlikely to benefit from Intelligent Data Placement.
· Disk groups that are more than 25% full. If the disk group is only 25% full, the management overhead is unlikely to be worth any benefit.
· Disks that have better performance at the beginning of the media relative to the end. Because Intelligent Data Placement leverages the geometry of the disk, it is well suited to JBOD (just a bunch of disks). In contrast, a storage array with LUNs composed of concatenated volumes masks the geometry from Oracle ASM.
The COMPATIBLE.ASM and COMPATIBLE.RDBMS disk group attributes must be set to 11.2 or higher to use Intelligent Data Placement.
Intelligent Data Placement can be managed with the ALTER DISKGROUP ADD or MODIFY TEMPLATE SQL statements and the ALTER DISKGROUP MODIFY FILE SQL statement.
· The ALTER DISKGROUP TEMPLATE SQL statement includes a disk region clause for setting hot/mirrorhot or cold/mirrorcold regions in a template:

ALTER DISKGROUP adndata1 ADD TEMPLATE datafile_hot
ATTRIBUTE (
HOT
MIRRORHOT);



· The ALTER DISKGROUP ... MODIFY FILE SQL statement that sets disk region attributes for hot/mirrorhot or cold/mirrorcold regions:
ALTER DISKGROUP adndata1 MODIFY FILE '+data/adn3/datafile/tools.255.765689507'
ATTRIBUTE (
HOT
MIRRORHOT);



Performing Disks Resizing in Disk Groups
The RESIZE clause of ALTER DISKGROUP enables you to perform the following operations:

· Resize all disks in the disk group
· Resize specific disks
· Resize all of the disks in a specified failure group
If a new size in the SIZE clause is omitted, then Oracle ASM uses the size of the disk as returned by the operating system. The new size is written to the Oracle ASM disk header and if the size of the disk is increasing, then the new space is immediately available for allocation. Similarly, when the size is decreasing, rebalancing must relocate file extents beyond the new size limit to available space below the limit. If the rebalance operation successfully relocates all extents, then the new size is made permanent, otherwise the rebalance fails.
The following SQL statement illustrates a sample scenario:
ALTER DISKGROUP adndata1
RESIZE DISKS IN FAILGROUP failgroup1 SIZE 150G;
Undoing Disks Drops in Disk Groups
The UNDROP DISKS clause of the ALTER DISKGROUP statement enables you to cancel all pending drops of disks within disk groups. If a drop disk operation has completed, then this statement cannot be used to restore it. This statement cannot be used to restore disks that are being dropped as the result of a DROP DISKGROUP statement, or for disks that are being dropped using the FORCE clause.

ALTER DISKGROUP adndata1 UNDROP DISKS;
Preparedness for Manual Rebalancing of Disk Groups



Manual rebalance of files in a disk group is possible using the REBALANCE clause of the ALTER DISKGROUP statement. This would normally not be required, because Oracle ASM automatically rebalances disk groups when their configuration changes.
Significantly important is the fact that the POWER clause of the ALTER DISKGROUP...REBALANCE statement determines the degree of parallelism, and subsequently the speed of the rebalance operation. It can be set to a value from 0 to 11. A value of 0 halts a rebalancing operation until the statement is either implicitly or explicitly re-run. The default rebalance power is set by the ASM_POWER_LIMIT initialization parameter. Likewise, the power level of an ongoing rebalance operation can be changed by entering the rebalance statement with a new level.

The ALTER DISKGROUP...REBALANCE command by default returns immediately so other commands can run while the rebalance operation takes place asynchronously in the background. It is practical to query the V$ASM_OPERATION view for to check the status of the rebalance operation.
The DBA can specify the WAIT keyword to cause the ALTER DISKGROUP...REBALANCE command to wait until the rebalance operation is complete.
Additional rules for the rebalance operation include the following:
· An ongoing rebalance command is restarted if the storage configuration changes either when you alter the configuration, or when the configuration changes due to a failure or an outage. Furthermore, when the new rebalance fails because of a user error, a manual rebalance may be required.
· The ALTER DISKGROUP...REBALANCE statement runs on a single node even if you are using Oracle Real Application Clusters (Oracle RAC).
· Oracle ASM can perform one disk group rebalance at a time on a given instance. Therefore, when multiple rebalances on different disk groups occur, Oracle processes these tasks serially. However, it is possible to initiate rebalances on different disk groups on different nodes in parallel.
Rebalancing continues across a failure of the Oracle ASM instance performing the rebalance.
· The REBALANCE clause (with its associated POWER and WAIT/NOWAIT keywords) can also be used in ALTER DISKGROUP commands that add, drop, or resize disks.
· Oracle restarts the processing of an ongoing rebalance operation if the storage configuration changes. If the next rebalance operation fails because of a user error, then a manual rebalance may be required.
The following SQL statement illustrates how to manually rebalance the disk group adndata2.
ALTER DISKGROUP adndata2 REBALANCE POWER 6 WAIT;
Tuning Rebalance Operations
When the POWER clause is omitted in an ALTER DISKGROUP statement, or when rebalance is implicitly run by adding or dropping a disk, then the rebalance power defaults to the value of the ASM_POWER_LIMIT initialization parameter, which can be adjusted dynamically.
When a rebalance is in progress because a disk is manually or automatically dropped, increasing the power of the rebalance shortens the duration for redundant copies of data on the dropped disk to be reconstructed on other disks.

The V$ASM_OPERATION view provides information for adjusting ASM_POWER_LIMIT and the resulting power of rebalance operations, including an estimate in the EST_MINUTES column of the amount of time remaining for rebalance completion.
Managing Capacity in Disk Groups
When Oracle ASM provides redundancy, such as when you create a disk group with NORMAL or HIGH redundancy, you must have sufficient capacity in each disk group to manage a re-creation of data that is lost after a failure of one or two failure groups. After one or more disks fail, the process of restoring redundancy for all data requires space from the surviving disks in the disk group. When the space left is insufficient, some files might end up with reduced redundancy which translates into one or more extents in the file not being mirrored at the expected level. Therefore, the REDUNDANCY_LOWERED column in the V$ASM_FILE view provides accurate information about files with reduced redundancy.
The following guidelines help ensure that there is enough space to restore full redundancy for all disk group data after the failure of one or more disks.

· For Normal redundancy disk group, it is best to have enough free space in the disk group to tolerate the loss of all disks in one failure group whose size could be equivalent to the size of the largest failure group.

· For High redundancy disk group, it is optimal to have enough free space to cope with the loss of all disks in two failure groups. The amount of free space should be equivalent to the sum of the sizes of the two largest failure groups.
The V$ASM_DISKGROUP view contains the following columns that contain information to help manage capacity:
· REQUIRED_MIRROR_FREE_MB indicates the amount of space that must be available in a disk group to restore full redundancy after the worst failure that can be tolerated by the disk group without adding additional storage. This requirement ensures that there are sufficient failure groups to restore redundancy. Also, this worst failure refers to a permanent failure where the disks must be dropped, not the scenario where the disks go offline and then back online.
The amount of space displayed in this column takes the effects of mirroring into account. The value is computed as follows:
· Normal redundancy disk group with more than two failure groups
The value is the total raw space for all of the disks in the largest failure group. The largest failure group is the one with the largest total raw capacity. For instance, when each disk is in its own failure group, the value would be the size of the largest capacity disk.
· High redundancy disk group with more than three failure groups
The value is the total raw space for all of the disks in the two largest failure groups.
· USABLE_FILE_MB indicates the amount of free space, adjusted for mirroring, that is available for new files to restore redundancy after a disk failure.
TOTAL_MB is the total usable capacity of a disk group in megabytes.
FREE_MB is the unused capacity of the disk group in megabytes, without considering any data imbalance.
With fine grain striping using 128 KB, the storage is preallocated to be eight times the AU size. The data file size may appear slightly larger on Oracle ASM than on a local file system because of the preallocation.
Oracle ASM Redundancy Levels
The Oracle ASM redundancy levels are, namely:
External redundancy
With this approach, essentially Oracle ASM does not provide mirroring redundancy and relies on the storage system to provide RAID functionality. Any write error causes a forced dismount of the disk group. All disks must be located to successfully mount the disk group.

Normal redundancy
Oracle ASM provides two-way mirroring by default, which means that all files are mirrored so that there are two copies of every extent.
High redundancy
Oracle ASM provides triple mirroring by default. A loss of two Oracle ASM disks in different failure groups is tolerated.
Oracle Automatic Storage Management Cluster File System (ACFS)
Oracle Automatic Storage Management Cluster File System (Oracle ACFS) is a multi-platform, scalable file system, and storage management technology that extends Oracle Automatic Storage Management (Oracle ASM) functionality to support customer files maintained outside of the Oracle Database. Oracle ACFS supports many database and application files, including executables, database trace files, database alert logs, application reports, BFILEs, and configuration files. Other supported files are video, audio, text, images, engineering drawings, and other general-purpose application file data.
Oracle ACFS establishes and maintains communication with the Oracle ASM instance to participate in Oracle ASM state transitions including Oracle ASM instance and disk group status updates and disk group rebalancing. Oracle Automatic Storage Management with Oracle ACFS and Oracle ASM Dynamic Volume Manager (Oracle ADVM) delivers support for all customer data and presents a common set of Oracle storage management tools and services across multiple vendor platforms and operating system environments on both Oracle Restart (single-node) and cluster configurations.
Oracle Automatic Storage Management Cluster File System (Oracle ACFS) and Oracle ASM Dynamic Volume Manager (Oracle ADVM) extend Oracle ASM support to include database and application executables, database trace files, database alert logs, application reports, BFILEs, and configuration files. Other supported files are text, images, audio, video, engineering drawings, and other general-purpose application file data.
Expected Limits of Oracle ADVM
The limits of Oracle ADVM are now discussed: The default configuration for an Oracle ADVM volume is four columns of 64 MB extents in length and a 128 KB stripe width. Oracle ADVM writes data as 128 KB stripe chunks in round robin fashion to each column and fills a stripe set of four 64 MB extents with 2000 stripe chunks before moving to a second stripe set of four 64 MB extents for volumes greater than 256 megabytes. Note that setting the number of columns on an Oracle ADVM dynamic volume to 1 effectively turns off striping for the Oracle ADVM volume.
On Linux platforms Oracle ASM Dynamic Volume Manager (Oracle ADVM) volume devices are created as block devices regardless of the configuration of the underlying storage in the Oracle ASM disk group.
The Oracle ASM instance is started during the Grid Infrastructure installation process whenever the Oracle Clusterware Registry (OCR) and voting files are configured within an Oracle ASM disk group. In that case, the Oracle ACFS drivers are initially loaded during Grid Infrastructure Installation based on the resource dependency. Besides, the Oracle ASM instance can also be started using the Oracle ASM Configuration Assistant and the Oracle ACFS drivers are loaded based on that action. In steady state mode, the Oracle ACFS drivers are automatically loaded during Oracle Clusterware initialization when the Oracle High Availability Services Daemon (OHASD) calls the start action for the Oracle ASM instance resource that also results in loading the Oracle ACFS drivers due to the resource dependency relationship. The start action for the Oracle ACFS drivers’ resource attempts to load the Oracle ACFS, Oracle ADVM, and Oracle Kernel Services (OKS) drivers into the native operating system.
In particular, the policy for the Oracle ACFS drivers is that they remain loaded until Oracle Clusterware is shut down. Likewise, the ora.drivers.acfs resource is managed automatically by Oracle High Availability Services Daemon (OHASD) and its state cannot be manually manipulated by srvctl or crsctl.
Managing Volumes in a Disk Group
An Oracle DBA can create Oracle ASM Dynamic Volume Manager (Oracle ADVM) volume in a disk group. The volume device associated with the dynamic volume can then be used to host an Oracle ACFS file system.
The compatibility parameters COMPATIBLE.ASM and COMPATIBLE.ADVM must be set to 11.2 or higher for the disk group.
The following examples illustrate possible ALTER DISKGROUP VOLUME SQL statements, Oracle ADVM volume management, including the functionality to add, modify, resize, disable, enable, and drop volumes:
SQL> ALTER DISKGROUP adndata1 ADD VOLUME voladn1 SIZE 12G;
Diskgroup altered.

SQL> ALTER DISKGROUP adndata1 RESIZE VOLUME voladn1 SIZE 16G;
Diskgroup altered.

SQL> ALTER DISKGROUP adndata1 DISABLE VOLUME voladn1;
Diskgroup altered.

SQL> ALTER DISKGROUP adndata1 ENABLE VOLUME voladn1;
Diskgroup altered.

SQL> ALTER DISKGROUP ALL DISABLE VOLUME ALL;
Diskgroup altered.

Oracle ACFS Registry Resource Management

The Oracle ACFS registry resource is supported only for Oracle grid infrastructure cluster configurations; it is not supported for Oracle Restart configurations.

The Oracle ACFS registry resource (ora.registry.acfs) is created by the root script that is executed following Grid Infrastructure installation. The start action for the Oracle ACFS mount registry is set online, if successful, otherwise to offline. The state of the Oracle ACFS registry resource is determined only by the active state of the mount registry. The online status is independent of any registry contents or the current state of any individual registered file systems that may exist within the Oracle ACFS registry.
In addition to activating the local node state of the mount registry, the Oracle ACFS registry resource start action assists in establishing a clusterwide Oracle ACFS file name space. On each node, the resource start action scans the contents of the clusterwide mount registry and mounts any file systems designated for mounting on the local cluster member. Before mounting a registered file system, the resource start action confirms that the associated file system storage stack is active and will mount the disk group, enable the volume file, and create the mount point if necessary to complete the mount operation.
The check action for the Oracle ACFS registry resource assists in maintaining the clusterwide Oracle ACFS file system name space. On each node, the check action scans the contents of the mount registry for newly created entries and mounts any Oracle ACFS file systems registered for mounting on the local node. Consequently, a new Oracle ACFS file system can be created and registered on one node of the cluster, and is automatically mounted on all cluster members designated by the Oracle ACFS registry entry.
The Oracle ACFS registry resource stop action is usually called during the Grid Infrastructure shutdown sequence of operations. To transition the registry resource to an offline state, all file systems on this cluster member that are configured with Oracle ADVM devices must be dismounted.
The Oracle ACFS registry resource clean action is called implicitly if the resource stop action fails to transition the resource to the offline state. In that scenario, the registry resource clean action can be called to effectively force the resource offline. The registry resource clean action scans the operating system internal mount table searching for any file system that is mounted upon an Oracle ADVM device. If any is found, the resource clean action attempts to umount the file system as in the resource stop action.
Each time Oracle Clusterware is started on a cluster node, the Oracle ACFS startup operations for the node consult the cluster mount registry and attempt to mount all Oracle ACFS file systems that are registered with that node. After each file system addition to the mount registry, the newly registered file system is automatically mounted on each node designated by the registry entry. If a registered file system is automatically mounted and is later dismounted, it is not automatically remounted until the system is rebooted or the Oracle Clusterware is restarted. It can be manually remounted using the mount command or Oracle Enterprise Manager.
The Oracle ACFS cluster mount registry action routines attempt to mount each Oracle ACFS file system on its registered mount point and create the mount point if it does not exist. The registry action routines also mount any Oracle ASM disk groups and enable any Oracle ADVM volumes required to support the Oracle ACFS mount operation. In the event that a file system enters into an offline error state, the registry action routines attempt to recover the file system and return it to an on-line state by dismounting and remounting the file system.
ACFS Individual File System Resource Management



Oracle ACFS individual file system resource is supported only for the Oracle grid infrastructure cluster configurations; it is not supported for Oracle Restart configurations.
Oracle ASM Configuration Assistant (ASMCA) facilitates the creation of Oracle ACFS individual file system resources (ora.diskgroup.volume.acfs). During database creation with Database Configuration Assistant (DBCA), the individual file system resource is included in the dependency list of its associated disk group so that stopping the disk group also attempts to stop any dependent Oracle ACFS file systems.
Typically, an Oracle ACFS individual file system resource is created for use with application resource dependency lists.
Besides, an Oracle ACFS file system that is to be mounted from a dependency action should not be included in the Oracle ACFS mount registry.
The start action for an Oracle ACFS individual file system resource is to mount the file system. This individual file system resource action includes confirming that the associated file system storage stack is active and mounting the disk group, enabling the volume file, and creating the mount point if necessary to complete the mount operation. If the file system is successfully mounted, the state of the resource is set to online; otherwise, it is set to offline.
The check action for an individual file system resource verifies that the file system is mounted. It sets the state of the resource to online status if mounted, otherwise the status is set to offline.
Tracking Performance Rebalancing Factors
The following factors could be used a factorial design to determine the impact of load balancing on ASM instances:
Factor 1: Redundancy
Factor 2: Clusterware
Factor 3: Allocation Unit
Factor 4: Striping Types
Factor 5: Extent design
Factor 6: Compatibility Issues
Factor 7: Support for ACFS
Factor 8: Support for ADVM
The design is left as a proposal for various interest groups and organizations, such as SNIA, which could work with various platforms, SAN architectures, and a variety of relevant storage technologies as well.



Exhibit 2. ASM Instance Stack and Storage System Infrastructure displaying disk groups
Concluding Remarks



Upon completion of this paper, the following remarks are widely applicable:
· ASM's rebalance process is very easy, and it happens without the intervention of the DBA or System Administrator. ASM simply rebalances a diskgroup whenever a disk is added or dropped.
· Rather than restriping all the data, ASM only needs to move an amount of data by using index techniques to spread extents on the available disks.
· In some failed scenarios, the DBA can manually perform rebalancing operations using the SYSDBA privilege for all destructive operations. In other scenarios, the SYSOPER privileges allows similar goals in non-destructive tasks.
· It is important to combine operations, such as ADD and DROP a DISK, at the same time, in order to minimize the overhead on both the ASM and database instances, and consequently or normal production operations.
· Finally, adjusting the ASM_POWER_LIMIT can enable controlled rebalancing while operations requiring data movement, control of redundancy and other-relevant are being performed.
· The above mentioned conclusions are valid for a native ASM environment, and one supporting ACFS and ADVM.
As ASM technology becomes a widely RAC infrastructure standard, with about 65% utilization on production environments, and nearly 25% of standalone database architectures, the future of this storage technology is certainly bright and it opens new doors to emerging technologies.

99 comments:

Anonymous said...

Thanks for sharing this informative blog. If you are looking for best PHP Training Institute in Chennai visit FITA IT training and placement academy

Unknown said...

Thanks for your informative article on ios mobile application development. Your article helped me to explore the future of mobile apps developers. Having sound knowledge on mobile application development will help you to float in mobile application development. Best iOS Training in Chennai | Best iOS Training Institute in Chennai

Unknown said...

Your information is really useful for me.Thanks for sharing such a valuable information. PHP Training in chennai | PHP Training chennai | PHP course in chennai | PHP course chennai

surangacloud said...

Your posts is really helpful for me.Thanks for your wonderful post. I am very happy to read your post.
cloud computing training in chennai | cloud computing training chennai | cloud computing course in chennai | cloud computing course chennai

Unknown said...


Informatica Training in chennai
Thanks for sharing such a great information..Its really nice and informative..

Unknown said...


Whatever we gathered information from the blogs, we should implement that in practically then only we can understand that exact thing clearly, but it’s no need to do it, because you have explained the concepts very well. It was crystal clear, keep sharing..
QTP Training in Chennai

Unknown said...

Very nice articles,thanks for sharing.

SAP Fico Training

SAP Hana Training

SAP HR Abap Training

Anonymous said...

Hybernet is a framework Tool. If you are interested in hybernet training, our real time working.
Hibernate Training in Chennai,hibernate training in Chennai

Unknown said...

This information is impressive; I am inspired with your post writing style & how continuously you describe this topic. After reading your post, thanks for taking the time to discuss this, I feel happy about it and I love learning more about this topic..
Informatica Training in chennai | QTP Training in Chennai



Unknown said...

This information is impressive..
cognos Training in Chennai

Unknown said...

GSSSB 2480 Revenue Talati Bharti Recruitment 2016

Its nice information given above by author. Thanks for the article. . . ...........

Unknown said...

Latest Govt Jobs Notification 2016


its impressive article regarding Government Jobs in India Thanks to the author............

Unknown said...

شركة تسليك مجارى بالرياض
level تسليك مجاري بالرياض
افضل شركة تنظيف بالرياض
تنظيف شقق بالرياض
شركة تنظيف منازل بالرياض
شركة غسيل خزنات بالرياض
افضل شركة مكافحة حشرات بالرياض
رش مبيدات بالرياض
شركة تخزين عفش بالرياض
شركة تنظيف مجالس بالرياض
تنظيف فلل بالرياض
ابغى شركة تنظيف بالرياض

Unknown said...

Excellent post!!!
sas-predictive-modeling training in chennai

Unknown said...

Thanks for the article. . .
datamodeling training in chennai

Unknown said...

Nice Blog to read
Android Training in Chennai | Best Android Training in Chennai | Best Android Training in Chennai with Placement

Sgraph Infotech said...

very interesting and informative blog...thanks for sharing the blog .

oracle sql training course in bangalore

louis philip said...

Nice it seems to be good post... It will get readers engagement on the article since readers engagement plays an vital role in every

blog.. i am expecting more updated posts from your hands.
Fitness SMS
Fitness Text
Salon SMS
Salon Text
Investor Relation SMS
Investor Relation Text
Mobile Marketing Services
mobile marketing companies
Sms API

abril joseph said...


Great post! I am actually getting ready to across this information, It's very helpful for this blog.Also great with all of the valuable information you have Keep up the good work you are doing well. One of the world’s most advanced and reliable electronic assessment system is operated by Pearson VUE. The testing centre at Besant technologies ,Bangalore.
Pearson Vue Exam Center in Bangalore |
Pearson Vue Exam Centers in Bangalore |

Suresh said...

Great Article… I love to read your articles because your writing style is too good, its is very very helpful for all of us and I never get bored while reading your article because, they are becomes a more and more interesting from the starting lines until the end.
Hadoop Training in Chennai
Big Data Training in Chennai
Python Training in Chennai
Python Training Centers in Chennai
Data Science Training in Chennai
Data Science Course in Chennai
Data Analytics Training in Chennai
Best AngularJS Training in Chennai
AngularJS Training in Chennai
QlikView Training in Chennai
Informatica Training in Chennai

kevingeorge said...

I believe there are many more pleasurable opportunities ahead for individuals that looked at your site.


Best RPA Training in Chennai

Unknown said...

I love to read your articles because your writing style is too good, its is very very helpful for all of us.
weblogic tutorial

Peter Johnson said...


Awe! What An Blog Very Helpful and interesting Really A great center for acquiring knowledge.Very Helpful Post And Explained Very Clearly About All the things.Very Helpful. Coming To Our Self We Provide Restaurant Equipment Parts . Really Thankful For the blogger providing such a great information.Thank you. Have a Nice Day.

Techtoolsinnovation said...

Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.
href=" http://techtoolsinnovation.com/datascience.html "> sas certified advanced analytics professional

Billy. said...

Phenomenal and supportive article.

read more

Unknown said...

This Blog Provides Very Useful and Important Information. I just Want to share this blog with my friends and family members. Salesforce Certification Training

Billy. said...

In your article, focuses grabbed my eye the most is the manner by which your writing, to give me a profound impression. Wish you would compose more. good fortunes!

iPhone cases

Unknown said...

Thank you for sharing valuable information.
visit us:Oracle RAC Training

nilashri said...

Inspiring writings and I greatly admired what you have to say , I hope you continue to provide new ideas for us all and greetings success always for you..Keep update more information..
AWS training in Chennai
selenium training in Chennai

nivatha said...

Thanks for the good words! Really appreciated. Great post. I’ve been commenting a lot on a few blogs recently, but I hadn’t thought about my approach until you brought it up. 
Data Science Training in Chennai
Data science training in bangalore
Data science online training
Data science training in pune
Data science training in kalyan nagar

Sai Elakiyaa said...

Really nice and interesting post. I was looking for this kind of information and enjoyed reading this one.
selenium Training in Chennai
Selenium Training Chennai
iOS Training in Chennai
iOS Training Institutes in Chennai
JAVA J2EE Training Institutes in Chennai
Java course

sathya shri said...

Really you have done great job,There are may person searching about that now they will find enough resources by your post

angularjs Training in marathahalli

angularjs interview questions and answers

angularjs Training in bangalore

angularjs Training in bangalore

angularjs Training in chennai

automation anywhere online Training

nivatha said...

Its really an Excellent post. I just stumbled upon your blog and wanted to say that I have really enjoyed reading your blog. Thanks for sharing....

Data Science Training in Indira nagar
Data Science training in marathahalli
Data Science Interview questions and answers


simbu said...

Read all the information that i've given in above article. It'll give u the whole idea about it.
Java training in Chennai | Java training in Tambaram | Java training in Chennai | Java training in Velachery

Java training in Chennai | Java training in Omr | Oracle training in Chennai

Unknown said...

I would really like to read some personal experiences like the way, you've explained through the above article. I'm glad for your achievements and would probably like to see much more in the near future. Thanks for share.

Data Science Training in Indira nagar | Data Science Training in btm layout

Python Training in Kalyan nagar | Data Science training in Indira nagar

Data Science Training in Marathahalli | Data Science training in Bangalore | Data Science Training in BTM Layout | Data Science training in Bangalore

Unknown said...

Nice Article,Great experience for me by reading this info.
thanks for sharing the information with us.keep updating your ideas.
Java training courses near me
Java Training in Thirumangalam
Java training courses near me
Java Training in Padur

Mounika said...

Thank you for this post. Thats all I are able to say. You most absolutely have built this blog website into something speciel. You clearly know what you are working on, youve insured so many corners.thanks

python training in chennai | python course institute in chennai | Data Science Interview questions and answers

Anjali Siva said...

Thanks for sharing this information admin, it helps me to learn new things. Continue sharing more like this.
DevOps course in Chennai
DevOps course
DevOps Training in Chennai
DevOps foundation certificate
RPA Training Institute in Chennai
AWS Training in Chennai
Blue Prism Training in Chennai

sai said...

Some us know all relating to the compelling medium you present powerful steps on this blog and therefore strongly encourage contribution from other ones on this subject while our own child is truly discovering a great deal. Have fun with the remaining portion of the year.
python interview questions and answers | python tutorialspython course institute in electronic city

Unknown said...

Hi, I have read your blog and I gathered some needful information from this blog. Thanks for sharing. Keep updating your blog.

Oracle course in Chennai
Oracle Training
Oracle Certification in Chennai
Best VMware Training
VMware course in Chennai
VMware Course

nilashri said...

Very nice post here and thanks for it .I always like and such a super contents of these post.Excellent and very cool idea and great content of different kinds of the valuable information's.
Data Science Course in Indira nagar | Data Science Course in btm layout

Python course in Kalyan nagar | Data Science course in Indira nagar

Data Science Course in Marathahalli | Data Science Course in BTM Layout

Anbarasan14 said...

Thanks for sharing a worthy information. This is really helpful. Keep doing more.

Spoken English Institutes in Bangalore
Spoken English Coaching Classes near me
English Speaking Classes in Bangalore
Spoken English Training Institute in Bangalore
Best Spoken English Coaching in Bangalore
English Speaking Course in Bangalore
English Spoking Coaching in Bangalore

yuvarani said...

This information is impressive. I am inspired with your post writing style & how continuously you describe this topic. Eagerly waiting for your new blog keep doing more.
ccna Course in Bangalor
ccna Classes in Bangalore
ccna Coaching Centres in Bangalore
ccna Certification Course in Bangalore
ccna Certification Training in Bangalore

sabee said...

Hmm, it seems like your site ate my first comment (it was extremely long) so I guess I’ll just sum it up what I had written and say, I’m thoroughly enjoying your blog. I as well as an aspiring blog writer, but I’m still new to the whole thing. Do you have any recommendations for newbie blog writers? I’d appreciate it.


AWS Training in Bangalore | Amazon Web Services Training in bangalore , india

AWS Training in pune | Amazon Web Services Training in Pune, india

AWS Training in Chennai|Amazon Web Services Training in Chennai,India


aws online training and certification | amazon web services online training ,india

sathya shri said...

Wow it is really wonderful and awesome thus it is very much useful for me to understand many concepts and helped me a lot. it is really explainable very well and i got more information from your blog.

angularjs online Training

angularjs Training in marathahalli

angularjs interview questions and answers

angularjs Training in bangalore

angularjs Training in bangalore

prabha said...

I read this post two times, I like it so much, please try to keep posting & Let me introduce other material that may be good for our community.
aws Training in indira nagar | Aws course in indira Nagar

selenium Training in indira nagar | Best selenium course in indira Nagar | selenium course in indira Nagar

python Training in indira nagar | Best python training in indira Nagar

datascience Training in indira nagar | Data science course in indira Nagar

devops Training in indira nagar | Best devops course in indira Nagar

cynthiawilliams said...

Wonderful post. Thanks for taking time to share this information with us.
Spring and Hibernate Training in Chennai
Spring framework Training in Chennai
Hibernate Training near me
Hibernate course in Chennai
Struts Training institutes in Chennai
Best Struts Training in Chennai

Radha Karthi said...

Fantastic blog!! with loads and loads of latest info.Thanks for sharing.

Selenium training in chennai
Selenium training institute in Chennai
iOS Course Chennai
French Classes in Chennai
Big Data Training in Chennai
Java Courses in Chennai
core java training in chennai

LindaJasmine said...

Amazing Post. Great write-up. Extra-ordinary work. Waiting for your next Post.
Social Media Marketing Courses in Chennai
Social Media Marketing Training in Chennai
Social Media Training in Chennai
Social Media Marketing Training
Social Media Marketing Courses
Social Media Training
Social Media Marketing Training
Social Media Courses

Sadhana Rathore said...

Excellent and useful blog admin, I would like to read more about this topic.
ccna Training institute in Chennai
ccna institute in Chennai
Python Training in Chennai
Python course in Chennai
R Training in Chennai
R Programming Training in Chennai
CCNA Training in Velachery
CCNA Training in Tambaram

Praylin S said...

Awesome post with great content. You are providing us valid information. This is really helpful. Do share more such articles. Regards.
Oracle DBA Training in Chennai
Oracle DBA Course in Chennai
Spark Training in Chennai
Spark Training Academy Chennai
VMware Training in Chennai
VMware Course in Chennai
Oracle DBA Training in OMR
Oracle DBA Training in Adyar

LindaJasmine said...

Awesome Writing. Wonderful Post. Thanks for sharing.
Blockchain certification
Blockchain course
Blockchain Training
Blockchain Training in Chennai
Blockchain course in Chennai
Blockchain Training in Porur
Blockchain Training in Adyar

Vicky Ram said...

Nice post. I learned some new information. Thanks for sharing.

Education
Technology

Jamess said...

QuickBooks Enterprise customer support cell phone number. We understand that your growing business needs your precious time which explains Enterprise Support Number we offer the most effective to the customers

steffan said...

“Just dial our QuickBooks Technical Support Number to inquire of about for Quickbooks Payroll customer support to eliminate payroll issues. We make use of startups to small-scale, medium-sized to multinational companies.”

kevin32 said...

QuickBooks encounter an amount of undesirable and annoying errors which keep persisting as time passes if you don't resolved instantly. Considered one of such QuickBooks Enterprise Upgrade Support 2019 issue is Printer issue which mainly arises because of a number of hardware and software problems in QuickBooks, printer or drivers.

kevin32 said...

You will find a lot of fields it covers like creating invoices, managing taxes, managing payroll etc. However exceptions are typical over, sometimes it generates the down sides and user wants QuickBooks Tech Support Phone Number client Service help.

QuickBooks Payroll Support said...

QuickBooks Tech Support Phone Number, QuickBooks PS series square measure several of the foremost common and then the most dangerous errors which our Users have to face. therein case, they ought to forthwith dial the fee QuickBooks Technical Support Service.

steffan said...

QuickBooks users are often present in situations where they should face lots of the performance plus some other errors due to various causes in their computer system. If you need any help for QuickBooks errors from customer care to get the means to fix these errors and problems, you can easily experience of Intuit QuickBooks Support Number to get instant help with the guidance of your technical experts.

kevin32 said...

Can be executed every user task with QuickBooks Payroll Support Phone Number Accounting software. Therefore you merely desire to install QuickBooks Payroll software and fetch the details, rest all the essential calculation will soon be done automatically as a result of the software.

Mathew said...

QuickBooks Tech Support Number is certainly one the large choice of awesome package when you look at the company world. The accounting area of the many companies varies according to this package.

rdsraftaar said...

Welcome aboard, to our support site par excellence where all your worries associated with the functioning of QuickBooks Enterprise are going to be addressed by our world-class team of QuickBooks Enterprise Tech Support Phone Number into the blink of an eye. If you are experiencing any hiccups in running the Enterprise type of the QuickBooks software for your business, it is advisable not to waste another second in trying to find a remedy for the problems.

Jamess said...

Time so you can get the QuickBooks Support We now have trained staff to soft your issue. Sometimes errors may possibly also happen as a consequence of some small mistakes. Those are decimals, comma, backspace, etc. Are you go through to deal with this? If you do not, we have been here that will help.

kevin32 said...


The principal functionality of QuickBooks Tech Support Phone Number is determined by company file. On the basis of the experts, if you want solve the problem, then you'll definitely definitely need to accept it first.

kevin32 said...

Imagine yourself in a situation in which you are filing a tax return on the night before the due date. Suddenly your QuickBooks Enterprise Support Number crashes in between and shuts down automatically.

QuickBooks Payroll Support said...

QuickBooks Customer Support Number whole package to set you free of Financial accounting and back office worries any moment so that you focus on your own expert area and yield potential development in business.

rdsraftaar said...

Our QuickBooks Payroll Tech Support has given an entirely new direction for the business, perhaps the beginners have adopted your path creating enhancements inside their accounting fields.

Mathew said...

all which is necessary is always to dial QuickBooks Tech Support Phone Number . Show patience; they are going to inevitably and instantly solve your queries.

Mathew said...

You're able to resolve this error by using the below troubleshooting steps you may also simply contact our QuickBooks Support Phone Number available at.You should run QuickBooks print and pdf repair tool to determine and fix the errors in printer settings prior to starting the troubleshooting.

Jamess said...

Sometimes errors may also happen as a consequence of some small mistakes. Those are decimals, Intuit QuickBook Support backspace, etc. Are you proceed through to cope with this? Until you, we have been here that will help.

kevin32 said...

Whether or perhaps not the matter relates to the tax table update, service server, payroll processing timing, Intuit server struggling to respond, or QuickBooks Payroll Support Number update issues; we assure anyone to deliver precise technical assist with you on time.

Mathew said...


In order to get technical help by experts, you can reach us at QuickBooks Enterprise Support phone number. After that, you can directly talk to one of our QuickBooks Enterprise Support Phone Number experts and get your queries answered within minutes.

jameswill11 said...

There are many features that produce QuickBook Tech Support Phone Number standout such as it provides bank security that aids one to go with IT maintenance smoothly. It's also possible to add wide range of users that can access company files at multiple locations.

QuickBooks Support Phone Number said...

So if that's the case, you can just get technical support from our amazing expert’s team, day time and night to easily solve any issues or errors pertaining to QuickBooks Tech Support Number. QuickBooks may be the leading and well-known name in this growing digital world.

QuickBooks Payroll Support said...

QuickBooks has availed many further versions with this specific software namely QuickBooks Pro, QuickBooks Premier, QuickBooks Enterprise, QuickBooks Point of Sale, QuickBooks Payroll, QuickBooks Accountant, QuickBooks Customer Tech Support Number and QuickBooks Windows & we fix all Quickbooks tech issues.

QuickBooks Support Phone Number said...

If you’re encountering any type of QuickBooks’ related problem, you could get all that problems solved just by with the QuickBooks Tech Support Number. QuickBooks users tend to be present in situations where they need to face a number of the performance and some other errors because of various causes in their computer system.

Jamess said...

QuickBooks Support is assisted by our customer support specialists who answr fully your call instantly and resolve all of your issues at that moment. It is a backing portal that authenticates the users of QuickBooks to perform its services in a user-friendly manner.

HP Printer Support Number said...

Thus, for HP laptop overheating fix the HP Printer Support Phone Number user needs to lighten the load to check out the behavioral changes. They can try to clean the fan (It can be completed with or without compressed air, vacuum and opening the vents).

HP Printer Support Number said...

No matter what much you try, you will find chances you will get stuck with a few of the most common HP Printer problems. And so, it is necessary for you yourself to take some quick some help from the HP Inkjet Printer Support Number experts. However, if you like are looking for HP Printer troubleshooting,

rdsraftaar said...

The principal intent behind QuickBooks Customer Support Phone Number is to provide the technical help 24*7 so as in order to avoid wasting your productivity hours. This is completely a toll-free QuickBooks client Service variety that you won’t pay any call charges. Of course, QuickBooks is one among the list of awesome package in the company world. The accounting part of the many companies varies according to this package. You'll find so many fields it covers like creating invoices, managing taxes, managing payroll etc. However exceptions are typical over, sometimes it generates the down sides and user wants QuickBooks client Service help.

accountingwizards said...

Intuit QuickBooks Support – The core strength of each business, be it a start-up or perhaps the biggest Multi-national firms is its accounting and management. it’s looked at to be one amongst the foremost tedious and tough tasks to manage the Payroll of your workers, making Invoices chase sales. It is nearly not possible not to wander away once in a very whereas following the written account to handle the accounts. That is why intuit created QuickBooks: associate degree accounting and management code. Today, QuickBooks is considered the most used accounting and management code out there.

Mathew said...

QuickBooks Support Phone Number is the one the large choice of awesome package in the company world. The accounting the main many companies varies according to this package. You will find so many fields it covers like creating invoices, managing taxes, managing payroll etc. However exceptions are typical over, sometimes it creates the down sides and user wants QuickBooks client Service help.

steffan said...

Creating a set-up checklist for payment both in desktop & online versions is a vital task that needs to be shown to every QuickBooks user. Hope, you liked your internet site. If any method or technology you can not understand, if that's the case your better option is which will make call us at our QuickBooks Payroll Tech Support Phone Number.

kevin32 said...


If QuickBooks Customer Service does not allow you to, go on and connect to us at QuickBooks support phone number. Most of us works 24*7 and serve its customers with excellent service whenever they contact us. Regardless of what issue is and however complex it truly is, we assure you that people provides you with optimal solution as soon as possible.

Jamess said...

You are getting this system into the legislative version. Storage is easy as well. The QuickBooks payroll software has tight security. Thus, all of your data are safe. You are able to put the password over there. This might protect the contents. It truly is great at fringe benefits. This program is SARS compliant. It is in reality good in tax statements. Submission of tax is not hard with QuickBooks Payroll Tech Support Phone Number.

Bryan Willson said...


QuickBooks Tech Support Number is toll-free as well as the professional technicians handling your support call may come up with an instantaneous solution that can permanently solve the glitches.

Rahul Aniket said...

Tamilrocker New Movie Download

jameswill11 said...

Rather than just wasting enough time to try finding out that ways to solve your problem at own, it really is definitely far more wonderful and cost-efficient to provide the decision at QuickBooks Tech Support Number also to have the tech agents to help you. You may be sure about the undeniable fact that they will have adequate experience and knowledge about this subject.

Blogsilly said...

Runtime Error 9999 happens when QuickBooks fails or crashes whilst it’s running, hence its name. It doesn’t necessarily mean that the code was corrupt in some way, but just that it did not work during its run-time. This kind of error will appear as an annoying notification on your screen unless handled and corrected. Here are symptoms, causes and ways to troubleshoot the problem. If you would like to learn how to Resolve Quickbooks Error 9999 yourself, you can continue reading this blog.

Blogsilly said...

Runtime errors are generally caused by incompatible programs running at the same time. It may also occur because of memory problem, a bad graphics driver or virus infection. Whatever the case may be, the problem must be resolved immediately to avoid further problems. Here are ways to remedy the error. If you would like to learn how to Resolve Quickbooks Error 9999 yourself, you can continue reading this blog.

aarthi said...

Great article for fresher who is also developer..waiting for the future updates.
Java training in Chennai | Certification | Online Course Training | Java training in Bangalore | Certification | Online Course Training | Java training in Hyderabad | Certification | Online Course Training | Java training in Coimbatore | Certification | Online Course Training | Java training in Online | Certification | Online Course Training

devi said...

I feel really happy to have seen your web page and look forward to so many more entertaining times reading here. Thanks once more for all the details.
he contents are masterpiece. you have done a fantastic activity on this subject!
Data Science Training In Chennai

Data Science Online Training In Chennai

Data Science Training In Bangalore

Data Science Training In Hyderabad

Data Science Training In Coimbatore

Data Science Training

Data Science Online Training

Free CSEET Online Classes said...

You can't imagine what I am going to tell you. Our institution is offering you a CS executive classes and a free of cost CSEET classes and many more to explore. So please contact us or visit our website at https://uniqueacademyforcommerce.com/

kishor said...

nices blog thanku so much this information.
free classified submission sites list
KISHorsasemahal

Quickbooks error said...

Quickbooks doctor file has been planned particularly for QB clients. This instrument has been created in the wake of joining two applications, one application name is QuickBooks Connection Diagnostic Tool and the other application is QuickBooks Company File Diagnostic Tool.

Oliver said...

fxchoice login Is More Than Just Another Forex Training Company. It Has A Financial Education Mission To Help People Worldwide Become Smarter Investors And Live Financially Independent Lives.

Tamil novels said...

Very useful and informative blog.
Tamil novel writers
Ramanichandran novels PDF
srikala novels PDF
Mallika manivannan novels PDF
muthulakshmi raghavan novels PDF
Infaa Alocious Novels PDF
N Seethalakshmi Novels PDF
Sashi Murali Tamil Novels PDF Download



VIPTHANOSS said...

cash queen

SwarnApp said...

This information really amazing thanks for share this article thank you..
Jewellery Billing Software
Jewellery Billing Software