Server consolidation: A technique to enhance cloud data center power efficiency and overall cost of ownership

Cloud computing is a well-known technology that provides flexible, efficient, and cost-effective information technology solutions for multinationals to offer improved and enhanced quality of business services to end-users. The cloud computing paradigm is instigated from grid and parallel computing models as it uses virtualization, server consolidation, utility computing, and other computing technologies and models for providing better information technology solutions for large-scale computational data centers. The recent intensifying computational demands from multinationals enterprises have motivated the magnification for large complicated cloud data centers to handle business, monetary, Internet, and commercial applications of different enterprises. A cloud data center encompasses thousands of millions of physical server machines arranged in racks along with network, storage, and other equipment that entails an extensive amount of power to process different processes and amenities required by business firms to run their business applications. This data center infrastructure leads to different challenges like enormous power consumption, underutilization of installed equipment especially physical server machines, CO2 emission causing global warming, and so on. In this article, we highlight the data center issues in the context of Pakistan where the data center industry is facing huge power deficits and shortcomings to fulfill the power demands to provide data and operational services to business enterprises. The research investigates these challenges and provides solutions to reduce the number of installed physical server machines and their related device equipment. In this article, we proposed server consolidation technique to increase the utilization of already existing server machines and their workloads by migrating them to virtual server machines to implement green energy-efficient cloud data centers. To achieve this objective, we also introduced a novel Virtualized Task Scheduling Algorithm to manage and properly distribute the physical server machine workloads onto virtual server machines. The results are generated from a case study performed in Pakistan where the proposed server consolidation technique and virtualized task scheduling algorithm are applied on a tier-level data center. The results obtained from the case study demonstrate that there are annual power savings of 23,600 W and overall cost savings of US$78,362. The results also highlight that the utilization ratio of already existing physical server machines has increased to 30% compared to 10%, whereas the number of server machines has reduced to 50% contributing enormously toward huge power savings.


Introduction
Human business activities involving gigantic information technology (IT) infrastructures are causing serious reparations to the environment and climate ecosystems causing severe problems toward the upsurging of global warming, climate control, CO 2 emissions, and environmental degradation. However, these business enterprises have substantial technologies, professional knowledge, creative thinking, and capacity and motivation to understand and achieve environmental sustainability. 1 Cloud computing is an emerging technology and trend comprising both ad hoc and infrastructure-based paradigms to overcome the issues and challenges of environmental sustainability. 2,3 The environmental impact of IT under the banner of green IT and green cloud computing has emerged as one of the major research areas and is being discoursed by various academic, research, and commercial business entities including the cloud data center (CDC) industry to implement energy-efficient CDCs. 4 CDCs are characterized as one of the key target areas in IT infrastructures where power consumption can easily be reduced and further diminished by applying various cloud-enabled energy-efficient techniques. These cloud infrastructures consume a high density of power results in generating a vast amount of greenhouse gases considered very harmful for environmental sustainability. 5 Power efficiency policy planners and architects have highlighted that power consumption in CDC is increasing alarmingly and will reach a level where it becomes really hard for the cloud owners to sustain their businesses and run the operational capabilities of their businesses. 6 The IT components of a CDC including physical server machines (PSMs) and their networking equipment are considered as major stakeholders, and they further require additional facility components such as cooling, heating, backup, and storage equipment which contribute profoundly toward electricity bills. 7 According to ES-1 report published in 2016, in the United States alone, the CDCs have consumed approximately 75 billion kWh of power in 2015, that is almost 2% of entire power consumption in the whole United States. The report also highlights that the overall CDC power usage has hastily increased to about 4% from 2010 to 2014. Power usage is projected to continue further and will be further increased from 2014 to 2020. The report also forecasts that based on current trend estimations; the CDCs in the United States will consume roughly 74 billion kWh in 2020 as shown in Figure 1. 8 According to IDC, the electronic data growth will expand from 4.5 ZB (zettabytes) in 2014 to almost 45 ZB by 2020. This huge data expansion will require more powerful CDCs to store and update data records. 9 Figure 1. ES-1 predicted cloud data center electricity usage. 8 According to a report published by Pakistan institute of development economics in the year 2018, highlights that the power shortfall in domestic and commercial sectors has become a hindrance for economic and commercial growth. The average shortfall in the commercial and domestic power sector is around 3000 to 4000 MWs. This power shortage leads to loadshedding and power outages across all business firms which costs billions of rupees of losses to Pakistan's economy every year. The same report also shows that about 55% of the total population, especially in rural areas, is facing an electricity shortage of up to 8-12 h per day. While in the commercial cities, the ratio of electricity shortage ranges from 4 to 8 h per day. 10 This critical and alarming situation in the power sector is considered one of the primary reasons in the country's slow economic growth and development. The state of the energy sector (and the extension of the economy) is not beyond redemption as shown in Figure 2. 10 This electricity gap is creating an enormous number of problems for the IT industry to run and provide their services especially CDCs, which are considered as the backbone of all major IT multinational companies.
Many solutions are being proposed by different researchers to fill this gap especially in the context of green cloud computing, where the solutions are being discourses for having any significant impact on achieving competitive advantage in implementing energyefficient CDCs. 11 The research proposed in this article attempts to increase the utilization of already installed physical machines in CDCs to support IT industry to overcome some of the power-related issues in Pakistan. The study aims to maximize the performance of CDCs and reduce their power consumption. We proposed a server consolidation technique based on Virtualized Task Scheduling Algorithm to help CDCs in improving their server machine utilization from 10% to 30% and also reducing the number of PSMs from 500 to 96. In our proposed technique, server consolidation was applied on PSMs where different virtual instances were created for several virtual machines (VMs) installed on existing physical machines. This was done using virtualization technology which enables CDCs to create and execute multiple virtual applications onto the same physical server, thereby increasing its utilization ratio. Furthermore, the proposed virtualized task scheduling algorithm was used to encumbered each virtual server machine (VSM) with multiple workloads from PSMs based on their execution capability and total workload available on the PSM. This technique enables us to have less active PSMs being replaced by VSMs which means more power efficiency, fewer power costs, and less CO 2 emission.

Problem background
A CDC mainly consists of server machines used for performing data processing, data storage devices responsible for the storage of data and backups, network devices, and equipment responsible for enabling communication between different components of data center. 12 Together with this, all equipment that processes, stores, and transmits digital information are called IT equipment. In a CDC, the majority of the power is consumed by this equipment, especially the server machines which do the majority of the processing for business operations. These server machines consume a lot of power, hence contributing heavily toward carbon emissions and global warming. 13 According to a report, an average 300-W server's electricity cost is around US$338 and CO 2 emission as much as 1300 kg during a year. The cost of cooling the equipment is not included in these statistics. 14 The exponential growth in Google, Facebook, Amazon, YouTube, and other multinational server farms over the last several years has seen a considerable increase in their number of servers. Google approximately has over 2.5 million servers in its CDCs, and this number is continuously increasing as the demands for huge data storage and processing increase. 15 The majority of large business enterprises recognize power efficiency as a major challenge in their IT infrastructures. 16,17 The efficiency of the physical resources is determined by the amount of energy consumption, which depends on the system deployed for the management and efficiency of running applications. 18 Each server is equipped with cooling devices to keep the CPU temperature fix. While the power consumption of cooling equipment greatly changes according to the data center's temperature as well as the power consumption of CPU. 19 According to Amazon estimates, 53% of the total budget of a CDC is allocated for the expenditures associated with the cost and operations of the servers, whereas the power costs accumulate to about 43% of the entire budget. This embraces both the direct power consumption (;18%) and cooling infrastructure (;24%). 20 The rapid increase in carbon footprints from information communication technology (ICT) infrastructures has motivated the researchers to emphasize and give priority to energy consumption and CO 2 emission in tier-level CDCs. 8 Recent statistics show that in the year 2015, CDCs consume around 1.8% of electricity worldwide, which contributes to almost 3% of CO 2 emissions globally. 21 It is further anticipated that this amount will be increased to 18% (about 6% of the global CO 2 emission) in 2020. 22 Another report on carbon emissions published in 2016 revealed that CDCs globally produce nearly 1.5 Mt of CO 2 in 2016, and this will be tripled by 2025. 23 To solve these problems, energyaware cloud infrastructure systems should be adopted and implemented to reduce total energy consumption and CO 2 emissions in CDCs. 24,25 To minimize global warming effects in Pakistan, it was recommended to use cloud-enabled solutions along with renewable energy sources for power generations across IT infrastructures. Furthermore, improving power infrastructure and stepping up electricity preservation techniques can be applied to prevent the negative effects on environment and electricity consumption in CDCs. 26

Related work
In this section, we review and highlight the related work on CDCs for implementing energy-efficient data centers. During the last decade, cloud computing solutions have been widely applied for sharing resources and services with better efficiency, speed, availability, reliability, and security. The problem comes when the demand for these cloud services from business enterprises increases. This leads toward expanding the currently existing data centers without looking into the aspect of huge power consumption by the server machines and other facilities which ultimately contribute to generating carbon emissions hazardous for environmental sustainability. 27 A recent report suggested that to minimize the negative effects of high-power consumption, cloudenabled infrastructures and service solutions will lead to almost 36% reductions in global power consumption by 2020. 28 Yang et al. 29 proposed a green power management solution for resource allocations in cloud VMs.
Dumitru et al. 30 presented a technique to increase energy management in data centers but did not give implementation details of the proposed solution. Pedram 31 proposed a solution for energy-efficient data centers based on performance measurement metrics, but the solution was not practical application in large tier-level CDCs. The proposed technique introduced the resources and their power provisioning. 31 The cloud-enabled solution proposed by Brandic 32 was focused on service-level agreement (SLA) management, and it was extremely important for both cloud service providers and consumers to prevent SLA's violations. Brandic 32 also proposed applications of cloud computing with a proactive solution which led to less power consumption to increase energy efficiency and optimize resource utilization. Maurer et al. 33 proposed an adaptive resource configuration technique for cloud infrastructure management. An energy-efficient mechanism proposed by Valliyammai et al. 34 used the fuzzy cmeans algorithm to reduce energy consumption by suspending the idle VMs while minimizing the SLA violations. Uddin and Rahman 35 proposed different energysaving techniques for CDCs to achieve maximum resource utilization and reduce the effects of global warming.
Warkozek et al. 36 proposed a solution based on CPU power consumption for VMs and services turning on the servers. In this solution, a linear model of electricity consumption was modeled based on running software on the servers. The main aim of this solution is to optimize the power consumption of CDCs due to load on servers. 36 An optimization technique was presented by Cioara et al. 37 aiming to identify non-optimal servers and then bring them to optimal states. This is a two-stage immune-inspired technique including initialization and self-optimization stages. 37 A green aware strategy was designed by Wang et al. 38 to eliminate power consumed by both IT functional devices and cooling systems. Green aware strategies enabled the cloud provider to make data center energy efficient while keeping the required applications at an acceptable level. 38 Le and Wright 39 have proved that scheduling the workload over the data center in the time-period can reduce both electricity cost and CO 2 emission.
However, the problem with most of these techniques is that they do not consider virtualized data centers and also did not focus on how to reduce CO 2 emissions in CDCs. 40,41 The nucleus research center also emphasized on implementing cloud-based solutions to reduce greenhouse gas emission to about 28% from 2010 to 2020. 42 This article proposes a technique, which applies server virtualization on servers inside the data center and distributes them into measurable units with their associated equipment into different resource pools depending on their workloads.

Proposed power efficiency solution for CDCs
This article proposes and implements a technique to improve the physical server utilization by reducing power consumption. In the proposed server consolidation technique, we consolidated several existing physical servers to virtual servers called VSMs based on the virtualized task scheduling algorithm. This technique virtually reduces the number of PSMs to almost half or even less than that based on the workloads to be executed. This technique not only reduces power consumption but also CO 2 emissions. The details of the proposed technique are given as follows.

Server consolidation
Server consolidation, a trend sweeping the data center industry, is a technology data center owner is using to reap tremendous financial and capital expenditure savings. 43 This technique instantiates and creates newly configured VMs on the existing PSMs for better utilization of processing capabilities of existing PSM with lower power consumption. Server virtualization maximizes the hardware utilization by aggregating more applications and services onto less hardware, thus enabling applications and services to coexist safely on the same server hardware with multiple operating systems operating simultaneously in the cloud environment. 44 Some of the key benefits of server virtualization are as follows: (1) it enables to increase the resource utilization for both IT infrastructures and non-IT infrastructures to increase the overall proficiency of CDCs by consolidating the workloads of PSMs onto VSMs, (2) it supports to improve the efficacy in conducting business processes more efficiently and with better performance in terms of cost, time, and space, thereby improving the overall business performance, and (3) it diminishes the overall cost of ownership of data center and contributes toward lowering the CO 2 emissions thus helps in achieving sustainable and environmentfriendly CDCs. 45 The increasing electricity and power costs in the CDC industry in Pakistan, such as banks, financial organizations, hospitals, and other multinationals are demanding to adopt and incorporate server virtualization solutions in their existing data center infrastructures to reduce power consumption and its associated costs. The proposed server consolidation technique instantiates and logically creates a virtual instance of an existing PSM. This virtualized instance comprises of three main components called as: VMs, host server machine, and hypervisor also called virtual machine manager (VMM). The VM directly intermingles with VMM and will be characterized as one of the main virtual infrastructure constituents. The host server machine associates itself with the VMM or the original PSM to handle and assign required resources to the newly created VM. The hypervisor or VMM is a cloud management layer between physical machines and their associated virtual infrastructures to handle the coordination between the two entities as shown in Figure 3. 46 In the proposed server consolidation technique, VSMs are allocated and reallocated between different PSMs using a technique called VM migration. This aids to increase the utilization of existing physical resources which eventually decreases the number of PSMs. The consolidation of VSMs increases the utilization of already installed physical machines, hence reducing power consumption. This reduction in power consumption mainly depending on the workload of several VMs operating on a physical machine as shown in Figure 4. The proposed technique distributes the workloads among VSMs using a virtualized task scheduling algorithm. For each workload (task) that previously requires a dedicated physical machine will now be reallocated to a newly created VSM. This enables us to assign several tasks from different PSMs onto one VSM, thus enabling us to switch the tasks assigned based on timestamp values and priorities set to process the assigned task. This is a complex process where jobs and tasks scheduled for one PSM are now reallocated and reassigned to different VMs. To achieve this, we proposed a Virtualized Task Scheduling Algorithm, which helps to consolidate multiple workloads from each physical server onto multiple VSMs. The scheduling process was implemented with a converter tool, which automates the conversion process of PSMs onto VSMs and helps to simplify the whole migration and cloning process.
The proposed server consolidation technique categorizes the underutilized PSMs into three resource pools of physical machines called PSM-1, PSM-2, and PSM-3 depending on different parameters such as the number of workloads, utilization ratio, performance, usage, and applications executed. These PSM classifications are defined as follows: PSM-1: these servers are the simplest type of servers and are extensively available in the majority of CDCs. These are mostly installed in shared computing environments, where provisioning for new servers is always available. The workloads processed by this category of servers require less processing speed and power, and they are considered as the idlest servers in the CDC. PSM-2: these type-2 server machines are more controllable and powerful servers compared to type-1. The typical tasks processed by these servers include testing and evaluating applications and processes. These servers are usually fewer in number compared to type-1 servers. PSM-3: these are the most powerful machines in any CDC. They are assigned the most complex, critical, and problematic tasks compared to types 1 and 2. These servers consume the maximum power and also emit the maximum CO 2 emissions. These servers are usually few in quantity and have a substantial effect on the total business processes.

Virtualized task scheduling algorithm
Business organizations are under tremendous pressure to report and account for their environmental footprints. Currently, business enterprises are forced to improve their sustainability efforts and recognize the importance of CO 2 emissions in building an environment-friendly ecosystem. To achieve this, the proposed server consolidation technique was employed in a CDC in Pakistan. During this process, initially, the CDC was restricted from adding any new hardware or other equipment especially the accumulation of new physical servers. In the next phase, a networked and integrated solution was instigated, where the VMs were created on already existing PSMs and workloads are migrated to more efficient VSMs by applying the proposed Virtualized Task Scheduling Algorithm. The aim was to reduce environmental footprints and decrease power consumption.
In the proposed algorithm, a data center component called load balancer creates and maintains a database containing an index of VSMs and their state information. The state can be either available or busy. In the first step, the VSM generates a request to the data center scheduler to know which VM is currently available in an accessible state to execute a specific task. The scheduler then inquiries the load balancer component for the provision of VSM. The index table will be scanned by a load balancer from the top until it reaches the first available VSM. Once the VSM is found, the algorithm transfers the request to the identified VSM through ID. Furthermore, the load balancer is acknowledged for the new allocation of jobs and tasks based on the parameters defined in the above section. Once this process is complete, the algorithm updates its index table accordingly. When a new request is generated by the client for performing a task, if appropriate VSM is not found, the load balancer returns 21 to show that currently there are no empty VSMs available to acknowledge the client's request. In this case, the client requests are queued with load balancer until they are being assigned to some free VSM.
When a VSM finishes the assigned tasks, a request is sent to the load balancer that it can ask the scheduler to de-allocate the VSM so that some new tasks should be allocated to it. The complete execution process of task execution is categorized into three phases. In the first phase, the VSM is created along with its contemporary state (active and busy) for the scheduler to schedule the tasks present in the queue. In the second phase, the scheduler assigns the new tasks from the list of tasks available in the queue. Once the task is assigned, VSM starts executing them. In the third and last stage, the cleanup or the obliteration of the VSM takes place. The overall efficiency and effectiveness of the proposed task scheduling algorithm are measured based on the number of jobs accomplished in time without considering the time required for the creation and destruction of VSMs. The pseudocode of the proposed algorithm is given as follows:

Data center case study power and cost analysis
The use of virtualization technology in an IT portfolio improves the cost per transaction, lessens data center space, power, and cooling requirements, and deploys resources easily in a fast-changing environment. It overdramatically changes the operating capability of CDCs by creating virtual instances on physical servers and the resources available in the CDC. In the case study, servers are categorized according to the workloads they perform, applications they execute, and the power they consume. Their power consumption was measured before and after the implementation of the proposed server consolidation technique. Annual power consumption in different segments of the CDC was measured in watts. The power required to maintain the cooling and other facility infrastructures was also measured using power measuring metrics. Other power consumptions in the form of additional leakages and other services, such as generators and uninterruptible power supply (UPS), are also measured. Finally, the overall annual cost applied to total power consumed in the CDC was calculated to measure the entire cost of ownership.
In the case study, server consolidation was practically initiated and employed on all types of PSMs to create logical instances of VSMs and to shift their workload onto VSMs. The efficiency and power consumption of the existing PSMs was measured after applying the proposed technique to obtain the overall power feasting costs. The outcomes of the case study were analyzed with more than 500 PSMs installed in the CDC. Although the data center was large and Pseudocode: virtualized task scheduling algorithm. Line 1. Phase 1: At the beginning, the index value for all SVM machines will be set to 0 as the current state of all machines is accessible Line 2. Phase 2: The client sends a new request to the DataCenterController Line 3. Phase 3: The LoadBalancer will be enquired for the subsequent provision by the DataCenterController Line 4: Phase4: The VSM index value will be parsed by DataCenterController to find the subsequent accessible VSM Line 5. Phase5: The found VSM Id is sent to DataCenterController by the LoadBalancer Line 6. Phase 2 will be continued Line 7. By applying the Round Robin algorithm, if idle VSM is not found, the index value of VSM machine will be reinitialized to ''0'' and this cycle will be patterned again to find out accessible state VSM machine Line 8. Phase 5. When the VSM finishes processing the request, and the DataCenterCOntroller receives the cloudlet response, it notices the load balancer of the VSM de-allocation Line 9. Phase 6: The Load Balancer updates the status of VSM in the allocation table to available Line 10. Phase7: Continue from Phase 2 Line 11. The purpose of the algorithm is to find the expected Response Time of each VSM and is calculated as Response Time = Fint 2 Arrt + TrDelay (1) Line 12. Where Arrt is the time when user request was received, and Fint is the time when user request was complete, and if there is any delay it can be found by applying below-given procedures: Line 13. TrDelay = TrLatency + TrTransfer (2) Line 14. Where TrDelay: time required to transmit data (TD) of a single application from source VSM to destination VSM Line 15. TrTransfer = TD/Bdtperuser (3) Line 16. Bdtperuser = Bdttotal/Nuser (4) Line 17. Where Bdttotal: total accessible bandwidth and Nuser: the number of requests from the user in the system contains hundreds of other servers, the top-level management agreed to implement the proposed server consolidation technique on 30% of the designated PSMs and their associated devices. Finally, all values before and after the installation of the server consolidation are gathered, compared, and analyzed to obtain total power consumption costs. Benchmarks are set to measure the overall efficiency using the standardized metrics from the Green Grid.

Power savings
The CDC industry took a lot of time to realize the importance of aligning their processes and operations conducive to power efficiency and reduced CO 2 emissions. Sustainable development requires a supply of energy resources that are sustainably available at an equitable cost. To achieve power savings, server consolidation was implemented to reduce the underutilization of already installed PSMs. The proposed technique showed a dramatic reduction in IT power systems, almost substantially more than the cost of servers. Table 1 shows the total number of PSMs in the CDC, their classification along with their utilization ratio, and power consumed in watts before applying server consolidation. A total of 500 servers are selected for performing the case study and are classified into three classes depending on the workloads by applying the proposed task scheduling algorithm. The total utilization ratio of all servers was about 10% on average, whereby each server averagely consumed about 100 W of power, as it was hard to get the accurate power consumption of each server, the total power consumed by all servers was approximately 50,000 W 500 3 100 = 50, 000 W Table 1 illustrates that in the CDC, on average, the PSMs are utilized for only 10%-12%. The proposed server consolidation technique increased the efficacy of these underutilized server machines by merging the tasks onto less PSMs. After applying server consolidation with ratios of 7:1 for PSM-1 servers, 5:1 for PSM-2, and 3:1 for PSM-3 servers, a decrease of almost half of the power consumption by these servers was observed, as shown in Table 2. The average consolidation ratio for all servers after applying consolidation was 5:1. The consolidation ratios are selected based on the tasks and processing capabilities of these servers. Table 2 also shows that after applying server consolidation, the total number of servers is reduced to 96 from 500. After applying server consolidation, each server averagely consumed 275 W of power compared to 100 W. This upsurge in power consumption was instigated by the intensification in the workloads and  processing capability of these servers. The utilization ratio also increased to almost 30% compared to 10% before consolidation. Table 2 further describes the average power consumed after applying server virtualization. The total power consumed by all PSMs after consolidation was only 26,400 W compared to 50,000 W before server consolidation, thus a saving of almost 23,600 W of power, which is almost half of the total power consumed before applying server consolidation was achieved. Furthermore, if the utilization ratio is further increased to 50%, about 350 W of power on average will be consumed by every server compared with 275 W. However, a decrease of almost two to three times of power consumption was possible to be achieved in these PSMs. In the CDC, where this case study was performed, the target utilization for PSMs was 30%, but in actual they are performing at only 5%, we can certainly decrease the power consumption to almost 90% by shutting down idle server machines. Thus, the proposed technique was beneficial in implementing power and energy-efficient and environmentally friendly data center as power consumption was almost reduced to half. The above results demonstrate that, when PSMs are consolidated with an average ratio of 5:1, a substantial decrease in the power consumption is obtained, that is, five physical servers (100 W each server on average) consumed a total of 500 W. However, after consolidating the load of these five PSMs, the average power consumption of one server becomes 275 W and its utilization ratio also upsurges to virtually 30%. It practically saves 225 W, which is nearly 50% of the total power consumed by five PSMs 500 W À 275 W = 225 W

Cost savings in PSMs
A typical data center has n different application environments and m servers. Each application executes several classes of transactions and requires several servers for processing. Servers can be dynamically provisioned among applications to optimize server utilization in the CDC. Server consolidation decreases the number of PSMs to reduce the power consumption and costs required to manage those servers. The power reduction has a great effect on the overall data center heating requirements, cooling load, and UPS backup time. It helps to increase performance proficiency, protracts generator backup times, and diminishes IT configuration of diverse interconnecting types of equipment and devices. This technique also reduces overall cost in terms of annual savings linked with cooling and other costs, such as generators, UPS, and power leakages. These cost-saving techniques have a great effect on the purchasing and maintenance of data center equipment and services.
Cost saving in PSM-1 servers. PSM-1 servers are the largest pool of servers in the data center under study. Therefore, their cost savings are also huge because their consolidation ratio was higher compared to other types of servers. Table 3 shows that by applying server consolidation, the number of servers was abridged to 36 from 250. Each server machine was consuming 250 W of power, and total power consumed by these servers including cooling, UPS, power leakage, and other additional electrical consumptions was approximately 17,187.5 kWh of total power consumption before applying server consolidation. The total cost for this power consumption was PKRs. 10,070,000. After applying consolidation, the number of servers was reduced to 36 and the total power consumed was 594 kWh and the costs are PKRs. 2,890,800. So, a total cost saving of PKRs. 7,179,200 (US$46,618) was achieved (US$1 = PKRs. 154) as given in Table 3.
Cost saving in PSM-2 servers. Table 4 shows that by applying server consolidation, the number of servers was reduced to 35 from 175. The power consumed by each server was 175 W; hence, the total power consumed by these servers including cooling, UPS, power leakage, and other additional electrical consumptions are approximately 6878 kWh of total power consumption before applying server consolidation. The total cost for this power consumption was PKRs. 8,427,120. After applying consolidation, the number of physical servers was reduced to 35 and total power consumed was almost 542 kWh and costs are PKRs. 2,715,600. So, a total cost saving of PKRs. 6,711,520 (US$43,581) was achieved (US$1 = PKRs. 154).
Cost saving in PSM-3 servers. Table 5 demonstrates that by employing the proposed methodology, the PSMs are reduced to 25 compared to 75 and each machine was consuming 75 W of power. The total power consumed by these servers including cooling, UPS, power leakage, and other additional electrical consumptions was approximately 1541 kWh of total power consumption before applying server consolidation. The total costs for this power consumption were PKRs. 3,600,360. After applying server consolidation, the number of servers was reduced to 35 and the total power consumed was 289 kWh and costs are PKRs. 2,027,064. So, a total cost saving of PKRs. 1,573,296 (US$10,216) was achieved (US$1 = PKRs. 154).
Total cost savings for all server machines. Table 6 shows the annual cost savings of PKRs. 12,067,776 (US$78,362) in all types of servers in terms of power consumption per kWh, including cooling costs, power leakage costs, additional costs (generators and UPS), and overall cost savings before and after server consolidation. Therefore, the power utilization ratio was greatly reduced. Lessening PSM diminishes power consumption as well as has a great effect on CDC IT equipment. It also helps in reducing CO 2 emissions to attain environmentally friendly and sustainable CDCs. From the results obtained, it is visible that the algorithm improved the efficacy and performance of the CDC. The algorithm performed much better during the three designated phases in which VSMs are created, tasks are allocated and reallocated to them by the scheduler, and finally, their annihilation process. The proposed  algorithm helps the CDC to increase the utilization of already installed PSMs and also save huge power consumption.

Key findings
1. By implementing server consolidation on an efficient platform, the data center annually saves 23,600 W of total power and the annual cost of PKRs. 12,067,776 kWh being wasted on idle servers and other cooling and infrastructure facilities. 2. The total number of processors within servers under management was reduced by up to 50% compared with the total value before workload consolidation; data centers were able to reduce their server hardware and software costs. 3. The overall utilization ratio of underutilized PSMs increased to 30% compared to only 10%, and this ratio can further be increased by involving more servers. 4. The overall task completion time of different IT services was increased to almost 50%.

Conclusion
In this article, we have discussed the enactment of server consolidation in a CDC in Pakistan. It has been pragmatic in this case study that the proposed technique along with the proposed algorithm leads to cost and power savings of almost 50% or even more. The article proposed a technique to classify CDC servers into three classifications depending on the applications and workloads they execute. A virtualized task scheduling algorithm was proposed to help data center managers to properly distribute the workload among different servers. Server consolidation was applied on all PSMs to migrate their workload onto VSMs by applying the proposed algorithm. The results indicate a power saving of nearly 23,600 W and an increase in the utilization ratio of already installed servers to almost 30% from 10%. The results also demonstrate a cost saving of PKRs. 12,067,776 kWh (US$78,362) being wasted on idle servers and other cooling and infrastructure facilities before implementing server virtualization.