Commits on Aug 14, 2019

1. Create composite indexes for [ResourceType, ReferenceUUID, ReferenceT… …

   …ype]
   
   It would improve the list runs call which contains filtering on [ResourceType, ReferenceUUID, ReferenceType]
   We've seen cases list runs take long to run when resource_reference table is large. 
   
   ```
   SELECT
      subq.*,
      CONCAT("[", GROUP_CONCAT(r.Payload SEPARATOR ", "), "]") AS refs 
   FROM
      (
         SELECT
            rd.*,
            CONCAT("[", GROUP_CONCAT(m.Payload SEPARATOR ", "), "]") AS metrics 
         FROM
            (
               SELECT
                  UUID,
                  DisplayName,
                  Name,
                  StorageState,
                  Namespace,
                  Description,
                  CreatedAtInSec,
                  ScheduledAtInSec,
                  FinishedAtInSec,
                  Conditions,
                  PipelineId,
                  PipelineSpecManifest,
                  WorkflowSpecManifest,
                  Parameters,
                  pipelineRuntimeManifest,
                  WorkflowRuntimeManifest 
               FROM
                  run_details 
               WHERE
                  UUID in 
                  (
                     SELECT
                        ResourceUUID 
                     FROM
                        resource_references as rf 
                     WHERE
                        (
                           rf.ResourceType = 'Run' 
                           AND rf.ReferenceUUID = '488b0263-f4ee-4398-b7dc-768ffe967372' 
                           AND rf.ReferenceType = 'Experiment'
                        )
                  )
                  AND StorageState <> 'STORAGESTATE_ARCHIVED' 
               ORDER BY
                  CreatedAtInSec DESC,
                  UUID DESC LIMIT 6
            )
            AS rd 
            LEFT JOIN
               run_metrics AS m 
               ON rd.UUID = m.RunUUID 
         GROUP BY
            rd.UUID
      )
      AS subq 
      LEFT JOIN
         (
            select
               * 
            from
               resource_references 
            where
               ResourceType = 'Run'
         )
         AS r 
         ON subq.UUID = r.ResourceUUID 
   GROUP BY
      subq.UUID 
   ORDER BY
      CreatedAtInSec DESC,
      UUID DESC
   
   ```
   
   /assign @hongye-sun

   

   IronPan authored Aug 14, 2019
   Configuration menu

   • View commit details
   • Copy full SHA for be2e9b1
   • Browse repository at this point

   Copy the full SHA

   be2e9b1 View commit details

   Browse the repository at this point in the history