I have the same problem! I can not remove the arm rests.

The center arm rest is attached to the console by 2 small Hex cap screws. The arm rest and intermediate slide panel are attached to the same hinge assembly with rivets.
to replace the upper arm rest, 1st remove the assembly from the console by removing the 2 hex screws this will allow you to work outside of the vehicle on a work bench. 3 rivets hold the arm rest to the hinge. You will need to drill out the rivets using a 1/8" drill bit. and install the replacement arm rest using new 1/8" pop rivets.
see illustration

Hi Konakalela, I'm Al the owner of Big As Auto Repair
Most arm rest have a round trim cover on the side of the seat that's removable. Simple remove that cover and there is a bolt behind it that holds the arm rest remove it counter-clock-wise and pull the arm rest straight outward. For further assistance go to my website. Have an awesome day Konakalela.
Auto Repair

depending on the type of arm rest you might have a look on eBay for " wheelchair arm rest" there are several universal types, they are often far cheaper to buy a new pair that to just replace one with original genuine parts.

Most likely 3 screws hold the armrest lid on.Towards the back.

There are two screws on either side of the armrest. Remove with Allen wrench or Phillips head. Be sure the armrest is closed position. After removing screws lift straight up to remove the armrest. Save the screws.

On most vehicles the arm rest are attached the same way, here is something you can try...Put the armrest in the upright position. Look along the bottom and sides of the armrest where it connects to the body of the seat. There should be small circles like tabs if the armrest is made of plastic, and there should be a seam that you can look through if the arms are made of cloth.

Pop out the tab or peel back the fabric to reveal the holding mechanism. If the chair is screwed in then you'll need a screwdriver, and if there's a nut or a bolt then you're going to need a socket wrench.

Hold the armrest up and make sure it doesn't move. Unscrew or unbolt the arm from the bucket seat. Pull the arm outwards once the hardware is removed.

using a flat blade tool like a small flat blade screwdriver, release retaining clip on arm rest and pull armrest from seat. slip the screwdriver between seat back and armrest and pry up on the retaining clip.

Un zip the cover on the armrest and pull it up to expose the bolt hole. unbolt and remove the arm rest and see what parts are damaged, sometimes it can just be tightened.

The armrests have covers that can be removed. Locate the zipper on the arm rest. Once you unzip it pull it toward the back of the arm rest and this will expose the one bolt that hold the armrest on. You will need a large torx and rachet to get it off. Once you take out that bolt the armrest will come right off.

You CAN remove the armrests- quite easily actually! All you need to do is grab a small pair of pliers. Behind each armrest are two tabs. With the pliers, pull the bottom tab out. Slide the top tab underneath the bottom. The armrest will pop right off! Which means you can wash the pad seat and all!