Resources I frequently mention during classes:
Stability ball to support your back in a chair:
There are many possible good options for each of the above.
You can purchase from the links provided (I get no commission) or use these search terms to find other similar products.
For the ball, I recommend you get one in the 9-12″ range that does NOT require a special pump to inflate (MUCH more practical for using on the go).