AEC + apps that are having Audio ( microphone ) issues ?
Hi everyone,
If you've released an app that uses AEC have you noticed an increase in issues for users who use a microphone?
We just had a major release including AEC and were hoping to see our 'echo' problems to go drastically down, and we did see echo issues drop, but the number of users having general audio issues went up by 50%.
Here's how our app uses Flash and LCCS audio APIs and how our customers use audio devices:
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Our app's flow for using mics:
1) We have some users running an app targeting FP 10.0 and some customers are running the same app targeting FP10.3 + AEC ( Same LCCS v2.2.0 lib )
2) Every 125 milliseconds ( Timer(125) ) we retrieve a mic and it's activity level:
3) Once in a while we get the mic names: Microphone.names[ _micIndex ];
4) We ask the OS for Microphones through a C app
5) Based on which mic a user selects we tell MicrophoneManager to also use that index:
6) When only 1 person publishes video, everyone else subscribes to it
7) View renders: Everyone publishes audio and subscribes to audio:
and
NOTE: We found an issue in LCCS code ( threw a lot of RTEs while checking for codecs on a mic) in a non-debug version of Flash Player when we were using:
instead of
-------------------------------------------------
Our users use a variety of USB headsets and USB+analog headsets and built-in mic+speakers:
* Some USB headsets report themselves as "USB <name of the product" ( to Flash and OS )
* Some USB headsets report themselves as "In Ear headset...etc" (to Flash and OS)
...etc
* Based on the API http://help.adobe.com/en_US/FlashPlatform/reference/actionscript/3/flash/media/MicrophoneEnhancedMod... vs http://help.adobe.com/en_US/FlashPlatform/reference/actionscript/3/flash/media/MicrophoneEnhancedMod... it says that *Flash* will use of these modes depending on the type of headset the user has ( USB vs non-usb ).
Question: Does LCCS also change settings of what type of mic to use based on USB vs non-usb headset ?
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Any ideas are welcome 
Thanks,
Alex G.
Here's what we are finding so far:
The obvious:
1) Retreiving a mic every 125ms wasn't a good idea just to get the activity level. This is just a part of the problem.
* this scenario is a stress test of the code below
2) Retrieving a mic could potentially break the enhanced microphone's data sent to the output channel ?
3) The very same thing happens when using AudioPublisher.microphoneManager.selectedMic instead of just MicrophoneManager
With the following source, clicking either of the two buttons seemed to have caused no audio output/feedback from a mic:
Using: Mac 10.6.8, FF 8 with and without LCCS 2.2.0
Here's my trace:
Regular Mic is gooooooooooood + activityLevel -1
Regular Mic is gooooooooooood + activityLevel -1
Regular Mic is gooooooooooood + activityLevel 0
Regular Mic is gooooooooooood + activityLevel 1
Regular Mic is gooooooooooood + activityLevel 1
Regular Mic is gooooooooooood + activityLevel 12
Regular Mic is gooooooooooood + activityLevel 1
Regular Mic is gooooooooooood + activityLevel 0
Regular Mic is gooooooooooood + activityLevel 1
Regular Mic is gooooooooooood + activityLevel 1
Regular Mic is gooooooooooood + activityLevel 8
Regular Mic is gooooooooooood + activityLevel 25
Enhanced Mic is gooooooooooood + activityLevel -1
Regular Mic is gooooooooooood + activityLevel -1
Enhanced Mic is gooooooooooood + activityLevel -1
>>>>>>>>>>>>>>>>>>>>>>>>>>>I got no audio right after this click <<<<<<<<<<<<<<<<
>>>>>>>>>>>>>>>>>>>>>>>>>>>Pressing the enhanced mic button caused the same output but no RTE <<<<<<<<<<
Enhanced Mic is gooooooooooood + activityLevel 32
Enhanced Mic is gooooooooooood + activityLevel 32
Enhanced Mic is gooooooooooood + activityLevel 32
Enhanced Mic is gooooooooooood + activityLevel 32
Enhanced Mic is gooooooooooood + activityLevel 32
Is there more that's beyond the above? Maybe/probably, gonna keep looking, if you have any suggestions let me know
Alex G.
