chore: Trying to fix the space problem

[FarrukhMasud]

What changes are proposed in this pull request?

We perform the cleanup regardless of using cached conda environment or not

How is this patch tested?

This is for pipeline, unit test not possible

Does this PR change any dependencies?

• No. You can skip this section.
• Yes. Make sure the dependencies are resolved correctly, and list changes here.

Does this PR add a new feature? If so, have you added samples on website?

• No. You can skip this section.
• Yes. Make sure you have added samples following below steps.

[FarrukhMasud]

/azp run

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 84.61%. Comparing base (26baa09) to head (eaa1b86).

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2365      +/-   ##
==========================================
- Coverage   84.67%   84.61%   -0.07%     
==========================================
  Files         331      331              
  Lines       17179    17179              
  Branches     1550     1550              
==========================================
- Hits        14547    14536      -11     
- Misses       2632     2643      +11     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.