I'm wondering if it's possible to replace the 8 x 4164 RAM ICs (8k x 8 ram)
Ugh, it makes my teeth hurt when people call 4164's "8k RAMs". Per
@tradde , yes, the geometry of these DRAMs is 64Kbits arranged as 64Kx1bit, not 8Kx8.
So the short version is, sure, anything's possible, but the question is how much damage you're willing to do to the PCB of your computer to make it happen and/or how much additional circuitry are you willing to hang off the DRAM sockets. The main problem here is that DRAM chips like those in the C64 have multiplexed address busses, unlike the SRAM chips you found, and turning a multiplexed address into a non-multiplexed one requires moving parts.
Looking at the schematics for an "8 RAM chip" C64 (later ones used two 64Kx4bit chips instead; FWIW, that doesn't simplify the problem at all) one approach you could take if you really wanted to go hog wild cutting up and destroying your computer is you could remove the two 74LS257 multiplexers at U13 and U25 and run the address lines A0-A15 from their sockets directly to a daughterboard that holds your 62256 chips. That should solve the multiplexing problem since you'll be getting the non-multiplexed version of the address from upstream of the multiplexers that mix it up for the DRAM chips. Then you rip out all the sockets for the original RAM chips run a jumper wire between pins 14 and 2 on the sockets, and run a wire from those bridges to your daughterboard; these are your data lines D0-7. Then you're going to need a couple more things: you'll need circuitry to adapt the RAS/CAS/WE lines used by the DRAM into the correct control signals for the SRAM, and you'll also need some circuitry to watch one of the address lines (A15 is the "right" one, but strictly speaking it doesn't matter) to split the 64K address space in two so half of it can be supplied by each 62256. It won't be that complicated but I'd need a couple minutes to write it all down and work out the equations for this; if you don't mind programmable it should be trivially easy to fit it all into a single GAL, but if you prefer discrete circuitry I think it still might be be doable in a single package.
(* Actually, after looking at the design linked below I think we can get away with no circuitry to adapt the control signals, but we still need to do some chip select magic.)
If you'd rather not destroy your C64 mainboard and go with a daughterboard that plugs into the DRAM sockets then you're going to need a circuit to de-multiplex the address bus in addition to adapting the control signals. How hard this is depends on the exact CAS/RAS waveforms of the target system; doing a little googling I found
This Github repo for a C64 SRAM converter and it verifies that a pretty trivial circuit works for the demultiplexing in a C64. Two chips in addition to the SRAM are enough for this design; it has a 74573 buffer and a 74F32 OR gate. The issue for you, though, is that this design uses a 128K SRAM (wasting half of it) instead of a pair of 32K chips. You're going to have to add the same circuitry as we need above to do chip select. It's not going to be a lot, but it's a consideration I guess. (Again, a GAL would make it trivial, but I think the worse case with discrete circuitry only adds one more chip.)
So... yeah, you can do it. Looks like people on Etsy are selling premade adapters with the RAMs already installed for less than $30, but if you want the satisfaction of DIY-ing it go for it. Assuming you don't want to go with the "rip out the multiplexers" option just copy the c64-sram design except lay it out for 8 sockets instead of two, and add some chip select circuitry. The original design turns on CS1 for its only RAM chip when both CAS and RAS are low; FWIW, I kind of doubt CAS is ever low by itself in the C64, if I'm right about that you could use two OR gates, one for each chip, that combine CAS with either the plain or inverted version of one of the address lines; I'd probably use the output side of one of the ones latched by the 74573.(*)
(Or if I'm wrong about CAS never being low without RAS just use a third OR gate, there's four of them in a 7432, to combine CAS and RAS and feed that *combined* signal into the ORs that gate on the address line. For the inverted/plain versions of the address line if you can surface-mount solder there are tiny single-gate versions of the 7404 inverter, but if you're stuck on through hole it's not the end of the world to use a whole one.)