iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more
Amazon ECS can detect a failed NVIDIA GPU and replace the affected container instance automatically, but the documented GPU health and repair workflow applies to Amazon ECS Managed Instances. It is not a general feature of every ECS cluster backed by ordinary EC2 container instances or an Auto Scaling group.
For a Managed Instances capacity provider, enable autoRepairConfiguration.actionsStatus as ENABLED, select GPU-capable instance requirements, and verify health with DescribeContainerInstances. ECS uses NVIDIA Data Center GPU Manager (DCGM) checks; when a critical failure marks an instance IMPAIRED, ECS drains it, starts a replacement, allows tasks to stop within their configured timeouts, and then terminates the impaired host.
What ECS GPU instance health checks actually cover
Amazon Web Services describes the boundary directly: “Amazon ECS monitors NVIDIA GPU health on Amazon ECS Managed Instances that use GPU hardware.” The signal is an instance-level health result, not a command executed inside an application container.
Quick wins for a faster PC:
Fix the driver behind crashes, sound loss and screen glitchesFind Drivers →Clear out junk files and repair common Windows errorsFree Scan →Scan for outdated or missing drivers - takes under a minuteDriver Scan →Managed Instances combine ECS capacity management with a provider configuration that specifies the cluster, networking, infrastructure permissions, and instance requirements. When those requirements include an accelerator type and count, ECS can run accelerated-compute checks in addition to its other container-instance checks. NVIDIA DCGM supplies the GPU health signal.
#1 Best Overall
- Powerful Turbo Fan:CAGIWIRU Electric Air Duster have reached speed up to 130000RPM,Can efficient remove dust and debris.With LED light and Three Adjustable Speed to meet with different cleaning tasks.
- With Attached USB C Fasting Charging cable.Charing 3 hours,Enjoy up to 240 minutes of use on the lowest setting, For third speed can use for 25mins.with four charging options to meet with your needs.
- Wide Application: attached 5 different nozzles,making it suitable for a variety of scenes, such as car,pet, pc, keyboards, and other electronic devices. It also serves for office and home clean duster.
- Handy Design & Portable:Cordless air duster electric nozzle is Light weight and small size, design and comfortable to hold and space saving, convenient to carry around. You can put it in your room or inside the car without taking up space.
- Economical &Reusable: Built durable materials with a long-lasting battery,our CAGIWIRU air duster it's a sustainable alternative to disposable air cans.
A critical GPU fault can change the container instance’s overall health to IMPAIRED. The instance’s statusReason may contain an NVIDIA XID identifier in the form XID_<number>. The XID is a diagnostic clue to preserve in incident records; it is not, by itself, a promise that every XID has the same root cause or recovery procedure.
Feature boundary: Managed Instances versus ordinary EC2 capacity
The automatic GPU-repair procedure documented by ECS is for a capacity provider whose compute type is Amazon ECS Managed Instances. A capacity provider backed by an EC2 Auto Scaling group is a different operating model. The material here does not establish that the Managed Instances DCGM repair action is available there, so do not assume that setting an Auto Scaling group health check creates an equivalent ECS GPU repair workflow. For EC2-backed capacity, use the health, replacement, and scaling controls belonging to that provider and validate their GPU behavior separately.
How the health signal differs from a task health check
There are two separate layers. Confusing them can produce a healthy service on a failed host or an unnecessarily replaced task.
| Layer | What it evaluates | Typical response | Use this wording |
|---|---|---|---|
| ECS container or task health | A health-check command from the task definition, executed inside the container | For an unhealthy task in an ECS service, the service scheduler stops that task and launches a replacement according to service deployment rules | Application or container health |
| ECS Managed Instances container-instance health | Host and runtime checks, ECS agent connectivity, accelerated-compute checks such as NVIDIA DCGM, and supported managed-daemon checks | If the instance is IMPAIRED and automatic repair is enabled, ECS drains and replaces the instance |
Instance or GPU hardware health |
A container health command can prove that a process responds to an endpoint while the GPU on the host is unusable. Conversely, a GPU host can be healthy while one model-serving process is wedged. Configure and monitor both layers when the application depends on GPU availability.
Rank #2
- Screen Cleaner is Your Screen’s New Bestfriend! - EVEO is proud to present a screen cleaner that’s perfectly suited for your TV. Meet your new screen cleaner, computer screen cleaner, laptop cleaner, iPad cleaner, Macbook,tv cleaner or any other electronic device. Our screen cleaner spray and wipe along with the included plush microfiber cloth, easily removes dust, fingerprints & other smudges on the screen’s surface. Clean effectively for a streak-free screen
- Gentle on your Screens - Our screen cleaner spray and wipes is compatible to be used even for the most sensitive LCD, LED, CRT, and OLED screens in proper use. Be at ease knowing that this product is compatible with all the major brands: LG, SONY, Samsung, Sharp, iPad, iPhone, Android screens, Kindle, PC monitors - we’ve got you covered! Can be used as LCD screen cleaner, tv cleaner, smart tv screen cleaner, and more
- Premium Super Soft Plush Microfiber Cloth - Included in this efficient screen cleaning kit. This screen cleaner spray and wipe has our signature plush microfiber cloth specially designed to comply with screens and monitors and leave them streak-free. Has been shown to effectively absorbs stubborn stains, zero streaks, and no fiber shedding. Always use this together with our screen cleaner for the best results
- Easy-to-Use Screen Cleaner Kit + microfiber cleaning cloth - The EVEO Screen Cleaning Kit will easily be your new favorite tool when it comes to taking care of the things you love most, quick and easy solution for a streak-free screen. Simply screw on the sprayer gun on the screen cleaner bottle. Spray the cleaning liquid onto the microfiber cloth, then wipe the screen until desired cleanliness & shine is achieved.
- Quality Screen Care Kit Worth Purchasing - Enjoy a convenient Screen Cleaner anytime, anywhere you need it. Your satisfaction is our top priority. We stand behind the quality of our products and that’s why, you shouldn’t be worrying at all. We manufacture the Best Screen Cleaner. and can be used for laptop cleaning kit, laptop screen cleaner, tv screen cleaner for smart tv. MacBook screen cleaner, monitor cleaner or screen cleaner spray for electronic devices with microfiber cleaning cloth
Prerequisites before creating the provider
Prepare these items before attempting to enable repair:
- An ECS cluster that will use an Amazon ECS Managed Instances capacity provider.
- The infrastructure role and instance profile required by Managed Instances, with permissions as described in the ECS Managed Instances capacity-provider documentation.
- VPC, subnet, and security-group choices that let the instance reach ECS control-plane endpoints, pull images, and send logs and metrics.
- Instance requirements that select GPU hardware, either by accelerator type and count or by appropriate GPU instance types. A requirement that selects only CPU and memory cannot satisfy a GPU workload.
- A task definition and service or run-task configuration that uses the Managed Instances capacity provider strategy.
- ECS agent version
1.57.0or later for the automated container-instance checks documented by ECS.
Capacity-provider configuration is the control plane for repair. A task definition’s healthCheck property does not turn on host replacement.
Create a GPU-capable Managed Instances capacity provider
Choose the provider in the ECS console
- Open the Amazon ECS console and select the target cluster.
- Open the cluster’s capacity-provider configuration and choose the option to create or associate an Amazon ECS Managed Instances capacity provider. Do not select an Auto Scaling group provider if your goal is this specific managed GPU repair workflow.
- Enter the required infrastructure role and instance-profile settings.
- Configure the network: VPC, subnets, security groups, and any required connectivity settings.
- Set instance requirements that include the accelerator type and the number of GPUs required by the workload, or select GPU instance types supported by the Managed Instances configuration.
- In automatic repair settings, set the actions status to
ENABLED. - Create the provider, associate it with the cluster, and use its capacity-provider strategy when deploying services or running tasks.
Console labels can vary as the ECS console evolves. The important values are the Managed Instances compute model, GPU-inclusive instance requirements, and the provider’s automatic-repair action status.
Free tools Windows power users keep installed
One-click scans. No signup required.
Create or update the provider through the API
The API field is managedInstancesProvider.autoRepairConfiguration.actionsStatus. The following fragment shows the relevant shape; replace surrounding fields with the required cluster, role, network, and instance-requirement values for your account. It is an illustrative configuration fragment, not a tested, copy-and-paste command.
Rank #3
- 【Large size】：Measuring 800 x 300 mm/ 31. 5×12 inches, which is wider and taller than others. Large mouse pad can perfectly fit your keyboard and mouse of any size, and there is also ample space for peripherals such as phones, tablets, etc.
- 【LED backlight mouse pad】：Blade Hawks RGB mouse pad provides 7 static modes and 7 dynamic modes will give you the options you are looking for. Power-off memory function remembers the last lighting mode you selected. The super glow fiber Chroma will give you a colorful gaming setup that you want.
- 【Anti-slip rubber base】：Made from Natural rubber, this gaming mousepad will firmly grip your desktop, allowing you to enjoy the ultimate precision in the games you are most passionate about. It also comes with a texture that enhances this ability even further.
- 【Smooth and waterproof surface】: Micro-textured cloth surface, for extremely precise mouse control and a smooth movement. When liquid splashes on the gaming mouse pad, it forms water droplets and slides down. Will not delay your work or gameplay.
- 【Plug and play】: This mouse and keyboard pad is powered by USB, plug and play, no driver required. One button control light modes. Press one time to change the lighting mode, press twice to change the brightness, press and hold about 3 seconds turn ON/OFF.
{
"managedInstancesProvider": {
"autoRepairConfiguration": {
"actionsStatus": "ENABLED"
}
}
}Use ENABLED to permit automatic replacement after ECS declares an instance impaired. Use DISABLED when you want monitoring without an automatic repair action—for example, during a controlled investigation. AWS states that GPU auto repair is enabled by default for Managed Instances, but inspect the actual provider rather than relying on that default.
For an existing provider, use the capacity-provider update operation to change the Managed Instances configuration, then read the resulting provider configuration and confirm the stored value. A successful API request is not sufficient evidence that the provider is using the intended GPU requirements or that the setting was applied to the provider associated with your production cluster.
Verify that ECS is collecting instance health
Query health with the ECS API or CLI
Call DescribeContainerInstances with the CONTAINER_INSTANCE_HEALTH include value. Supply the cluster and one or more container-instance identifiers:
The Tool Desk
Outbyte Driver Updater FREEFix the driver behind crashes, sound loss and screen glitchesFind Drivers →Outbyte PC Repair FREERepair Windows errors before they cause bigger problemsFix Now →aws ecs describe-container-instances
--cluster <cluster-name>
--container-instances <container-instance-arn-or-id>
--include CONTAINER_INSTANCE_HEALTHInspect healthStatus.overallStatus and each entry in healthStatus.details. ECS documents these overall states:
Rank #4
- 【Softer and More Comfortable】Vaydeer wrist rest has unique diamond pattern, which is the combination of softness and aesthetics. The materials of wrist rest are improved into higher quality memory foam and covered with silky smooth lycra. The computer wrist rest makes you as comfortable and cushiony as like rest your wrists on clouds.
- 【Ergonomic Wrist Saver】The wrist rests for keyboard and mouse comes with a 17.32×3.15×0.83 inch keyboard wrist pad and a 5.94×3.15×0.83 inch mouse wrist support. Based on ergonomic design, the unique concave shape is the perfect fit for your wrist joints. The wrist rest pad fits most computer keyboards and laptops, improve hand and wrist posture, release your wrist and arm stress.
- 【Non-Slip Rubber Bottom】Featuring an anti-skid silicone base on the bottom, this wrist keyboard support stays firmly in place on your desk, preventing the padding from sliding around, ensuring stable and consistent wrist support during extended computer sessions.
- 【Better Experience & Pain Relief】Our keyboard arm rest is beneficial to alleviate the soreness caused by direct contact and friction between your arm and a hard desk surface, reducing the risk of wrist fatigue or carpal tunnel. The soft texture of memory foam can evenly distribute the pressure around your wrists and provide good support with just enough give.
- 【Helpful in Multiple Scenarios】Whether you're working, studying, writing, typing, gaming, this keyboard and mouse rest combo is an essential accessory to add comfort and support to your hands and wrists. It’s also a great gift for men, women, family, friend, coworker, gamer, teacher, etc.
OK: the evaluated checks are healthy.IMPAIRED: at least one critical check has failed and the instance is considered impaired.INSUFFICIENT_DATA: ECS cannot yet make a reliable health determination.INITIALIZING: checks are still starting.
The most severe check status determines the overall status. During a GPU incident, also inspect the container instance’s statusReason for an XID_<number> value and record the individual detail entries. An INITIALIZING or INSUFFICIENT_DATA result is not the same as a confirmed GPU failure and should not be treated as one.
Check the agent and event stream
Automated container-instance checks require ECS agent version 1.57.0 or later. Confirm the agent version on the instances and watch ECS container-instance health change events. Correlate the event time with task placement, the transition to DRAINING, service deployment activity, and CloudWatch metrics. This separates a DCGM failure from an agent-connectivity problem, a networking interruption, or an application-level task failure.
What happens after a GPU instance becomes impaired
With automatic repair enabled, ECS uses a start-before-stop sequence rather than simply rebooting the same host. The documented order is:
Recommended Free Tools
- Drain the impaired instance. ECS sets the container instance to
DRAINING, preventing new tasks from being placed there. - Provision a replacement. Managed Instances obtains replacement capacity that satisfies the provider’s requirements, including its GPU requirements.
- Stop existing tasks gracefully. Tasks on the draining instance are allowed to stop according to their task stop-timeout settings. Services can then place replacement tasks on available capacity.
- Terminate the impaired instance. After draining, ECS removes the failed host.
Tasks do not continue uninterrupted on the same physical host. Applications should therefore tolerate task termination, restart, and model or cache initialization on a new instance. Set task stop timeouts long enough for the application to flush state, but do not assume that a long timeout makes the host usable while its GPU is failing.
Best Value
- 【No Drill Mounted】Cable management tray can be assembled in as little as 3 minutes or less-simply. Side clips easily clampe the edge of desk, pass through the holes on the sides, and secure excess cables with baskets. Desk cable management supports inward or outward installation to meet your needs in different scenarios, and provides you with great convenience when collecting and organizing wires.
- 【Rubber Pad Protects Desk】Wire organizer under desk built-in soft rubber pads on the clamp protect your desk from scratches, so you will not damage your furniture or office.
- 【Sturdy and Beautiful】Cord management under desk is made of high-quality carbon steel and holds about 15 lbs. The wire basket has 2 holes on each side of the tray to enable your cables to pass freely. Cable baskets are suitable for desk thickness use from 0.4" to 2.4".
- 【Space Saving & Keep Organized】Desk cable management tray holds all your power cords, outlet strips, USB hubs and computer transformers hidden from your feet, and the data cables will not enter the vacuum cleaner to keep your desk clean and tidy. Desk wire organizer is also suitable for use in the kitchen and outdoors.
- 【Reduce Safety Risks】Cable tray under desk keeps all plugs away from your kids, no more worry about tripping. Using 2 holes wire tray saves extra space, helps you easily cabling and wire protection. The mesh design is not easy to accumulate dust, but avoids safety accidents caused by messy wires.
Repair rate limits
Repair is deliberately capacity-aware. ECS limits draining to no more than 20% of a capacity provider’s instances at one time. For a provider with fewer than nine instances, at most one instance drains at a time. A small GPU fleet can therefore recover serially, and a second impairment may wait until the first repair has progressed. Design service desired counts and spare capacity with this limit in mind.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Observability for GPU incidents
Container-instance health details
Use DescribeContainerInstances --include CONTAINER_INSTANCE_HEALTH as the authoritative ECS view of the health decision. Capture the overall status, detail names and statuses, status reason, instance identifier, and timestamps from your surrounding event and logging systems. Preserve the XID code when present; it helps correlate the ECS decision with NVIDIA and operating-system diagnostics.
Container Insights GPU metrics
A health status tells you that ECS considers a check healthy or impaired; it is not a time series of utilization, memory use, or per-container GPU activity. AWS documents enhanced observability in Container Insights for NVIDIA DCGM metrics on GPU-enabled Managed Instances. With enhanced observability, GPU telemetry can be collected at container, task, and instance levels. Basic Container Insights does not collect those GPU metrics. Enable the enhanced mode when you need utilization and workload-level context, and keep the ECS health events for replacement decisions.
What’s actually slowing this PC down?
Pick the symptom - the matching free tool is one click away.
Useful correlations during an incident
- Compare the first
IMPAIREDevent with DCGM and CloudWatch metric timestamps. - Check whether the service scheduler placed replacement tasks after the instance entered
DRAINING. - Look at task stop reasons and stop-timeout behavior to identify slow shutdowns.
- Verify that the replacement instance registered with the cluster and passed its initial health state before expecting GPU tasks to start.
- Review whether the provider had enough healthy capacity for the 20% drain limit and the service’s desired count.
Application health checks still matter
Define a task-level health check for the failure modes your application can detect: for example, a local inference endpoint that verifies model readiness or a worker process that must answer a diagnostic command. ECS runs that command inside the container and can replace an unhealthy service task. Keep the command focused on application readiness rather than trying to reproduce DCGM’s host-level checks in shell code.
Use instance health for host and GPU failures, task health for process and application failures, and service deployment settings for how replacements are rolled out. None of these layers guarantees that a stateful job can resume from the same point; checkpoint long-running GPU work to durable storage when interruption is unacceptable.
Troubleshooting decision tree
The instance is healthy, but the GPU workload is failing
- Inspect the task health result, container logs, and application-level GPU initialization errors.
- Check enhanced Container Insights DCGM metrics for abnormal utilization, memory, or error patterns.
- Confirm that the task landed on a GPU-capable Managed Instances provider and received the expected GPU allocation.
- If only the application is unhealthy, let the service scheduler replace the task rather than forcing host repair.
The instance is IMPAIRED
- Read
healthStatus.detailsandstatusReasonfromDescribeContainerInstances. - Record any
XID_<number>identifier and correlate it with the health-change event and DCGM telemetry. - Confirm the provider’s
actionsStatus. If it isDISABLED, ECS will continue monitoring but will not perform automatic repair. - Check whether the instance is already
DRAININGand whether the repair-rate limit is delaying another drain.
The status remains INITIALIZING or INSUFFICIENT_DATA
- Verify the ECS agent is version
1.57.0or later. - Check agent connectivity, instance networking, and registration state.
- Allow the checks to initialize before declaring a hardware failure.
- Look for health-change events and detail-level results rather than relying only on the overall state.
No replacement appears
- Confirm that the compute provider is Amazon ECS Managed Instances, not an EC2 Auto Scaling group capacity provider.
- Read the provider configuration and verify
autoRepairConfiguration.actionsStatusisENABLED. - Check that the provider can launch an instance satisfying its GPU accelerator requirements in the selected subnets and availability zones.
- Review the 20% or one-instance drain limit, desired service capacity, and any task stop timeouts that keep the impaired host in the draining phase.
Operational checklist
- Use Amazon ECS Managed Instances for the documented GPU auto-repair flow.
- Select accelerator type and count, or GPU instance types, in the provider’s instance requirements.
- Install or verify ECS agent version
1.57.0or later. - Set and verify
managedInstancesProvider.autoRepairConfiguration.actionsStatusasENABLED. - Query
DescribeContainerInstanceswithCONTAINER_INSTANCE_HEALTH. - Alert on
IMPAIRED, health-change events, and GPU-relatedstatusReasonvalues. - Enable enhanced Container Insights when container-, task-, and instance-level NVIDIA DCGM metrics are required.
- Test service behavior when a task is stopped and relaunched on replacement capacity.
- Plan for graceful shutdown, checkpointing, and startup time on a newly provisioned GPU host.
- Document a separate recovery procedure if the cluster uses ordinary EC2 instances or an Auto Scaling group.
Configuration example in context
A practical rollout is to create a Managed Instances provider with GPU-inclusive requirements and automatic repair enabled, associate it with the cluster, and deploy a small canary service using that provider strategy. Query the registered container instance until its health state is OK, then verify that the service receives GPU-capable placement. During normal operation, retain health-change events and DCGM metrics. During an impairment, let ECS perform the documented drain-and-replace sequence while the service scheduler restores task count on the replacement capacity.
Do not interpret a successful canary deployment as proof that every GPU failure mode is repaired instantly. Replacement is capacity- and timeout-dependent, and the documented drain limits are especially significant for small providers.
Do these 3 things before closing this tab:
1Scan for outdated or missing drivers - takes under a minute2Repair Windows errors before they cause bigger problems3Fix the driver behind crashes, sound loss and screen glitchesQuick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
