iOS DRM Fixes for License Fetching

[nickfujita]

Adds in fixes for using DRM on iOS while for both using getLicense and fetching the license in native code.

There are a couple fixes taken from https://github.com/react-native-video/react-native-video/pull/2128/files.

This expands on that work to update the formatting in the case where the user would like to not specify a function to fetch the license on their own using getLicense. Rather this should allow the native code to fetch the license for you.

In several of the comments on the original iOS DRM PR, it was mentioned that it only seemed to work with getLicense. But even then, there were still some changes that others required in order to get that working. Adds fixes that seem to be used by many from the original PR comment from @Hobahung

• Cleans up contentID extraction and contentIdData encoding
• Updates the onGetLicense arguments to only those used by others using this library
• Fixed crash for onGetLicense when the certificate data was assumed to be base64 encoded, and incorrectly passed as spc data.
• Updates spc data formatting in the license request performed on the native code side when onGetLicense is not present

@STIENLILLY @Hobahung
Would you mind testing this PR for iOS to make sure it's still working for your applications? I noticed that in the example in the original ios drm PR getLicense was being used, as I assumed that the code without it was not working. Would you mind trying without the getLicense method as well?

@danhodos @sunnyoui
Had to make a few updates described above in order to get the DRM license fetching and successful loading into the player working. These differ from the logic in the original PR that you had both created/validated. So I wanted to make sure to include you both in the discussion as well to make sure that this PR still provides a working DRM solution for you both on iOS

[nickfujita]

@STIENLILLY @Hobahung @danhodos @sunnyoui

Just wanted to try pinging you all again to see if you were still using react-native-video in your projects; specifically DRM for iOS. If so, could you please test out the changes in this PR, as I would like to ensure that the changes still work with your projects.

If we don't hear back, will have to assume that you are no longer using RNV, and will look to merge the changes after a review from @cobarx

[nickfujita]

@cobarx Could you please review this PR when you get a chance, so that we may proceed to merge to master?

[0xleeaki]

Hi @nickfujita ,
I have just tested your function, it has an crash in ios when using drm video.
My config.

{
                    type: DrmPlayerComponentConfig.DRMType.FAIRPLAY,
                    certificateUrl: AppConfig.videoCertificateUrl,
                    headers: {
                      Authorization: drmMediaSource.headers.Authorization,
                      'Content-Type': 'application/x-www-form-urlencoded',
                    },
                    getLicense: (
                      spc: string | Blob,
                      contentId: any,
                      licenseUrl: string,
                    ) => {
                      const formData = new FormData();
                      formData.append('spc', spc);
                      return fetch(licenseUrl.replace('skd', 'https'), {
                        method: 'POST',
                        headers: {
                          Authorization:
                            drmMediaSource.headers?.Authorization || '',
                          'Content-Type': 'application/x-www-form-urlencoded',
                        },
                        body: formData,
                      })
                        .then((response) => {
                          return new Promise((resolve, reject) => {
                            response.blob().then((blob) => {
                              new Response(blob).text().then((text) => {
                                resolve(
                                  text
                                    .replace('<ckc>', '')
                                    .replace('</ckc>', ''),
                                );
                              });
                            });
                          });
                        })
                        .catch((error) => {
                          setErrorMessage(error.toString());
                        });
                    },
                  }

[nickfujita]

@Hobahung thanks for testing. When using a provided getLicense method, the main differences appear to be the way contentId and contentIdData values are derived. I took them from this PR, and they appear to be working for me.

For my project I'm not using getLicense, so updated to code to have separate handing logic when using getLicense or not, and have changed the way the contentIdData value is initialized to the same way that you had it in your comment on the original PR. Could you please try testing again and seeing if that works? If not, could you also please try manually updating contentId to what it was originally, and see if that works for you instead? NSString *contentId = url.host;

Also I'm not very versed in Objective-c, so would be open to any recommendations of formatting this better, as there is much duplicate code in this approach.

[nickfujita]

Hi @Hobahung wanted to ping you again to see if you could please try this out again. I'd like to get this resolved and merged by the end of the week if possible.

[KrzysztofGastolek]

Hi @Hobahung wanted to ping you again to see if you could please try this out again. I'd like to get this resolved and merged by the end of the week if possible.

Hi, I've tried your solution, but it doesn't work. Still got error:

*** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '*** -[__NSPlaceholderDictionary initWithObjects:forKeys:count:]: attempt to insert nil object from objects[0]'
*** First throw call stack:
(0x193512878 0x1a7a68c50 0x193582e1c 0x19358f270 0x193403550 0x1933f5dd0 0x1057955a8 0x19310524c 0x193106db0 0x193117a68 0x193118120 0x1dbc087c8 0x1dbc0f75c)
libc++abi.dylib: terminating with uncaught exception of type NSException
*** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '*** -[__NSPlaceholderDictionary initWithObjects:forKeys:count:]: attempt to insert nil object from objects[0]'
terminating with uncaught exception of type NSException

I've also tried to change contentId. No luck.

[nickfujita]

Thanks @KrzysztofGastolek for testing. I spent some time debugging, and found that the reason for this crash appears to be that in the example from input from @Hobahung, the licenseServer field is not being passed. This is required, since the the adjustments suggested by @Hobahung request that the licenseServer be passed back to getLicense as licenseUrl: string,. However if the field is not passed, a crash occurs. I've since added a catch to default the license URL to and empty string, if it is not passed in the initial config. Please pass an input value for licenseServer if you expect the getLicense to return an argument for licenseUrl in your example above.

While debugging, I've also gone ahead and cleaned up the code to better preserve the original code between getting the license via JS or native. And also went ahead and reverted the changes from this PR, since it seems that it was not in the original comment from @Hobahung in the PR for the original ios drm support.

@Hobahung in your comment on the original drm PR, you reference the licenseUrl variable, but I am not finding this specific variable name in the existing code. So I'm assuming that it's coming from the input config field licenseServer. Could you please confirm that was your intention, or were you pulling licenseUrl from somewhere else? Also if it's being passed as an input config argument, only to be referenced again in JS, can we just omit this from the arguments for the getLicense callback since the js code should already have this value?

[nickfujita]

@Hobahung & @KrzysztofGastolek Hope you both had a relaxing and safe new year! Was wondering if either of you would possibly have a few min to have a look at my last comment. The reason for the error seems to be that the licenseServer field was left blank in the input config, which is why it was crashing.

[KrzysztofGastolek]

@Hobahung & @KrzysztofGastolek Hope you both had a relaxing and safe new year! Was wondering if either of you would possibly have a few min to have a look at my last comment. The reason for the error seems to be that the licenseServer field was left blank in the input config, which is why it was crashing.

Hello. I hope you had a good one as well!

About the crashing issue, I've actually used @Hobahung solution (with licenseUrl change made by myself) and it works ok. I will try to check your solution today or tommorow and get back with results.

[KrzysztofGastolek]

@nickfujita

OK, so I've replaced my current react-native-video (working) with your version and my app is not crashing anymore, but still not working with DRM. Function getLicense is never invoked. After a while I am getting timeout error:

error: code: -16833 domain: "CoreMediaErrorDomain" localizedDescription: "The operation couldn’t be completed. (CoreMediaErrorDomain error -16833 - Nie można ukończyć tej operacji. (Błąd CoreMediaErrorDomain -16833 - crypt key received slowly))" localizedFailureReason: "" localizedRecoverySuggestion: "" target: 99

There are no errors in xcode.

[nickfujita]

@KrzysztofGastolek Thanks for testing. Could you please confirm whether or not you are passing an input value for the licenseServer field, and possibly a sample of what your input config looks like?

In your implementation, from where was the licenseUrl argument in the getLicense callback function being sourced if not provided via the input config parameter licenseServer

[KrzysztofGastolek]

@KrzysztofGastolek Thanks for testing. Could you please confirm whether or not you are passing an input value for the licenseServer field, and possibly a sample of what your input config looks like?

In your implementation, from where was the licenseUrl argument in the getLicense callback function being sourced if not provided via the input config parameter licenseServer

OK, so here is my drm object passed to video component (I've removed specific data):

certificateUrl: "https://fp-keyos.licensekeyserver.com/cert/[certId].der" getLicense: ƒ (spc, contentId, licenseUrl) headers: customdata: "mycustomdata" licenseServer: "https://fp-keyos.licensekeyserver.com/getkey" type: "fairplay"

As you can see, I am passing licenseServer, but that is not a problem. The issue is that video component never invokes getLicense function. In the function I am expecting licenseUrl all the times, but still, if the function is not invoked, it doesn't matter :) My app is a rough prototype, because I am actually working with react-native for the first time and have very limited knowlege about native code, but I will try to debug this module to provide more information. If you have any hints how to debug this, feel free to contact me. IOS DRM playback with custom getLicense is crucial to my app and I care about this fix a lot :)

[KrzysztofGastolek]

I think I've found the problem. In Video.js function _onGetLicense it is expecting data.spc value but it gets:

contentId: "..."
licenseUrl: "https://fp-keyos.licensekeyserver.com/getkey"
spcBase64: "..."

EDIT:

I've changed data.spc to data.spcBase64 and it works :D

[nickfujita]

@KrzysztofGastolek Thanks for finding that. Def. and oversight on my part (sorry about that). I confirmed the fix on my end as well.

Would you mind giving it a once over again with the latest commit, and provide your approval on this PR if possible (comment approval is also fine).

[nickfujita]

@leolaki would you also mind testing with the latest fix?

[KrzysztofGastolek]

@KrzysztofGastolek Thanks for finding that. Def. and oversight on my part (sorry about that). I confirmed the fix on my end as well.

Would you mind giving it a once over again with the latest commit, and provide your approval on this PR if possible (comment approval is also fine).

I've checked new commit both on iOS and Android builds, and it works ok. I am using custom getLicense function and specific licenseServer url.

[klauszhang]

Greetings @nickfujita,

I've checked your latest code with my setup, but I cannot get getLicense called for some reason. So HLS playback always fails (I assume there was no DRM call to license server).

I managed to get android DASH + Widevine working, but no luck with iOS DRM. I can get HLS content playing when there are no DRM.

I also tried the DRM information on safari browser it works fine so I assume the certificate the server works fine. I'm pretty new to RN so could have made some silly mistake here.

Here are my settings:

      <Video
        style={{...}}
        controls={true}
        source={{
          uri: source.src,
          type: 'm3u8',
        }}
        drm={{
          type: DRMType.FAIRPLAY,
          certificateUrl: drm.certificate_url,
          licenseServer: drm.key_request_url,
          base64Certificate: false,
          getLicense: spcString => {
            console.log('spcString', spcString)  // <- this never logs out

            // I copied some of the code from samples. But the function not called so I assume they doesn't matter anyway
            const base64spc = Base64.encode(spcString)
            const formData = new FormData()
            formData.append('spc', base64spc)
            return fetch(
              source.key_systems['com.apple.fps.1_0'].key_request_url,
              {
                method: 'POST',
                headers: {},
                body: formData,
              }
            )
              .then(response => response.text())
              .then(response => {
                return response
              })
              .catch(error => {
                console.error('Error', error)
              })
          },
        }}
      />

[KrzysztofGastolek]

@klauszhang

Maybe try to remove base64Certificate key from drm prop. It works without it in my app. Also add handler for onError prop to catch errors.

function onError(e) {
  console.log('Error', e);
}

<Video
    ...
    onError={onError}
/>

[klauszhang]

@KrzysztofGastolek Thanks for the hint, I tried to remove base64Certificate and it doesn't seem working.

Can you confirm your sample works with DRM enabled content? As if I use apple sample HLS sample (http://devimages.apple.com/iphone/samples/bipbop/bipbopall.m3u8) it works fine but not working with DRM enabled.

I also tried to add onError log and it does log anything..

[KrzysztofGastolek]

@klauszhang

Yes, newest commit works fine with both FAIRPLAY (iOS with custom getLicense) and WIDEVINE (android).

[klauszhang]

Thank you for confirming @KrzysztofGastolek .

I tried a few times but still cannot get it working. I noticed the code stopped at

dispatch_queue_t queue = dispatch_queue_create("assetQueue", nil);

and afterwards resourceLoader never get run.

I am not even rookie of objective-c so I cannot debug what's going on here? I attached xcode debugger and there's no error is thrown. seems to me after the queue dispatched there's nothing happen.

[KrzysztofGastolek]

Thank you for confirming @KrzysztofGastolek .

I tried a few times but still cannot get it working. I noticed the code stopped at

dispatch_queue_t queue = dispatch_queue_create("assetQueue", nil);

and afterwards resourceLoader never get run.

I am not even rookie of objective-c so I cannot debug what's going on here? I attached xcode debugger and there's no error is thrown. seems to me after the queue dispatched there's nothing happen.

Are you sure you are passing correct source? I don't know excactly how player works, but maybe it stops before it even tries to obtain DRM data? I don't think m3u8 is correct type for a source.

[klauszhang]

I believe it is, m3u8 is HLS streaming format and I can get none DRM playback successful. If you want I can DM you the source and have a try. FYI @nickfujita as well. I guess there's something wrong with m3u8 type with fairplay?

[KrzysztofGastolek]

@klauszhang

I think type is for mime., m3u8 is playlist type, not mime. For HLS the correct mime is application/vnd.apple.mpegurl, but I had no problems with playback without specifying type. I can check your source with my app if you want.

[nickfujita]

@klauszhang
While testing, I'm also using m3u8, so should not be an issue. Could you possibly try a couple things:

• Without, base64Certificate parameter
• Make sure on latest commit for PR branch (44b5915). There was a fix made on the 7th that prevented getLicense from being triggered

[nickfujita]

Also, @klauszhang, could you please confirm you are testing iOS drm on a physical device, and not the simulator?

[klauszhang]

Thank you for your reply. I added you both to the sample repository. the sample is in https://github.com/klauszhang/drm-poc/blob/master/sample.js

[klauszhang]

@nickfujita sorry I was trying that on the simulator, I will try on a physical device really quick to see if it works

[klauszhang]

got slightly different log if run on physical device. But it crashes when run.

2021-01-12 23:05:47.646581+1300 drmpoc[870:930669] -[NSURL length]: unrecognized selector sent to instance 0x281f620d0
2021-01-12 23:05:47.647076+1300 drmpoc[870:930669] *** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '-[NSURL length]: unrecognized selector sent to instance 0x281f620d0'
*** First throw call stack:
(0x23301998c 0x2321f29f8 0x232f361c8 0x23301f1d4 0x233020e6c 0x232fc672c 0x232fc9dc8 0x10438ad5c 0x1046768ac 0x1046765ac 0x233021010 0x232f02be0 0x2390c8168 0x2390c7ea4 0x105ad36f4 0x105ad4c78 0x105adcbf4 0x105add8b4 0x105ae777c 0x232c39114 0x232c3bcd4)
libc++abi.dylib: terminating with uncaught exception of type NSException
*** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '-[NSURL length]: unrecognized selector sent to instance 0x281f620d0'
terminating with uncaught exception of type NSException
(lldb) 

[nickfujita]

@klauszhang Took a look at the sample project, and it appears that it is using the latest release version of react-native-video, and not the branch for this PR. While testing the changes for this PR, please utilize the PR branch or else the changes being tested will not be present.

"react-native-video": "git+ssh://git@github.com/nickfujita/react-native-video.git#44b5915f671589caea0df71924b6cffc1858d10b",

I updated the dependency locally, and found that the getLicense method is being triggered as expected. Could you please confirm.

[klauszhang]

@nickfujita Thank you very much for your help, I was copying the code and replace it in node_modules and expecting it would apply the change but it seems not.

It is working like a charm now and you're right it only plays on the physical device rather than on simulator.

[EyMaddis]

Related as it breaks some DRM providers: #2305

[mezalejandro]

Hello, I am testing DRM and it is not working for me on iOS, can someone help me?

[KrzysztofGastolek]

Hello, I am testing DRM and it is not working for me on iOS, can someone help me?

Sure.

[mezalejandro]

Hello @KrzysztofGastolek , I am testing with an iphone simulator and it does not work but now testing on a physical device I get this message

<Video
            source = {{
              uri: 'https://xxx.cloudfront.net/out/v1/xxxx/index.m3u8',
          }}
          drm = {{
              type: DRMType.FAIRPLAY,
              licenseServer: 'https://fps.ezdrm.com/api/licenses/XXXX-XXXX-XXX-XX',
              certificateUrl: 'https://xxx.cloudfront.net/live/players/test/1.0/fairplay.cer'
          }} 
          onError={(err) => console.log('error ', err)}
          style={styles.backgroundVideo} />

[mezalejandro]

in getLicense how do I pass the base64?
In this way?

getLicense: (spcString) => {
                const base64spc = Base64.encode(`${contentId}+${certificateUrl}`)

[samueleastdev]

@mezalejandro I am getting the exact same error as you did you manage to resolve this issue?

[cihanbas]

in getLicense how do I pass the base64? In this way?

getLicense: (spcString) => {
                const base64spc = Base64.encode(`${contentId}+${certificateUrl}`)

Hi @mezalejandro how do you solve this issue? i'm getting same issue

[mezalejandro]

Hello @cihanbas in my case contentId I had those data, so that it works.
The contentId was passed to me.