measure_operator_cost not implemented for op Cache_103

[TonyTangYu]

I installed FlexFlow from the source code. When I test moe in examples/cpp/mixture-of-experts folder, it gave me the following error: measure_operator_cost not implemented for op Cache_103 (type 25). Please report this issue to the FlexFlow developers.

[lockshaw]

@virena Can you check and see if it's still not implemented? If it's not we can discuss with Zhihao if we plan on adding support for this

[reyna-abhyankar]

The current implementation sets all cost_metrics fields to 0. There is a // TODO: implement at the top, so I'm guessing we do want to support something a little more than a dummy function? @lockshaw

[lockshaw]

@jiazhihao What does the Cache operator do? I'm guessing it's MoE-related? I know you'd mentioned some of those operators should be deprecated, is this one of them or should @virena go and implement measure_operator_cost?

[lockshaw]

The Cache code has been removed in #622, so this PR will effectively be closed/rendered out-of-date by that. I'm guessing a new implementation will be added back in in #475 (@jiazhihao @gabrieleoliaro correct me if I'm wrong here)