If you really want to override the Woocommerce template then you have to follow the same structure that Woocommerce support. Let say, you need to customize the shop page. Then copy the following file from the woocommerce plugin directory.
Then paste it to your theme directory with the same name as
Make sure to keep the same name as woocommerce plugin has otherwise it will work for you.