Hi nanashikun! Welcome to the forum.
As a start you will likely get more joy setting your box’s performance settings to on-demand, though that may only make a small improvement. From my own experience, I’ve found that the greater thermal improvements are achieved by performing some case and heatsink modifications (like actually adding a proper heatsink).
You can draw inspiration from other daring community member’s exploits in this thread:
Even minor mods to airflow can make a noticeable improvement. The unfortunate reality is that it seems that with a lot of boxes, thermal considerations were not a high priority.
Best of luck!