Package Torello.Browser.BrowserAPI
Class WebAudio
- java.lang.Object
-
- Torello.Browser.BrowserAPI.WebAudio
-
public class WebAudio extends java.lang.Object
This class was built using the Chrome Remote Dev-Tools A.P.I., which is specified by two JSON-RPC Files. These files were obtained from the Chrome Dev Tools Protocol Git Hub Page, which has a "Tip of Tree" (the latest) API-Specification Page Here: JSON-RPC Protocol Specification.
These files were converted into this Java-Browser (CDP) Library. The intention is to have them function in a similar fasion to the Node.js Tool known as 'Puppeteer', Microsoft's 'Playwright' and of course the Main-Stay 'Selenium.' The Java-HTML JAR Library merely implements the Java Types & Commands defined by Google's DevTools Protocol.
🧠View the Google CDP API:
This domain allows inspection of Web Audio API. https://webaudio.github.io/web-audio-api/
The top-level description and explanation for this class (this comment, at the top this Java-Doc Page) is repeated, verbatim, across all of the domain classes which comprise Google's CDP API.This class is intended to be used with a Browser Instance
These methods have been tested, to some degree, using Google Chrome. In order to use this class you must start a web-browser instance and make a connection to the browser using aRemote Debugging Port. Google-Corporation is the developer of this API, but any browser which accepts a Remote Debug Port Connection over Web-Sockets.
Google-Chrome was used during the development process of the classes in this particular package. Lately, it has been asserted Microsoft has switched to using the Chrome Browser-Engine for its Microsoft Edge Internal Code-Base. Therefore, there may some functionality available when running the methods in this class with Microsoft-Edge.
Check whether the your Web-Browser will allow itself to be driven by theWeb-Socket RDP-Port 9223. See the examples available in packageTorello.Browserto undertand how to build aPageConnandBrowserConnWeb-Socket Connection, and how to build aWebSocketSenderinstance in order to execute the methods in this class.
Web-Socket & JSON API:
Every one of the methods that reside in this class are designed to do nothing more than:- Accept Parameters from the User, and "Marshall Them" into a Valid JSON-Request
- Transmit the Marshalled Request-JSON to a Headless Web-Browser over a Web-Socket Connection
- Receive BOTH that Command-Results AND any Browser Event-Firings from the Web-Socket
- Parse JSON Method-Results and Browser-Event Firings, and Subsequently Convert them to Standard Java-Types
- Report these Method-Results and Browser-Events to the User via a User-Registered, Event-Listener (Events) or a Promise Object (Command Responses / Results)
Unlike the bulk of the Java HTML JAR Library, there is very little native Java-Code, and very little testing that may be done on any of the classes & methods in this package. The code inside these classes does nothing more than marshall-and-unmarshall Java-Types into Json-Requests (and vice-versa). The Java-Script & Browser modules inside of a Google-Chrome instance are, theoretically, handling these requests, and returning their results (or events) over the Web-Socket Connection.
It has been asserted (by Google Chrome Developers) that some of these methods are only "partially working" or "experimental".
Asking Chat-GPT for Help:
The LLM otherwise known as "Chat-GPT" does, indeed, have an expert level of knowledge about the "Remote DevTools Protocol". The API that theChrome DevTools Protocl (CDP)exports is extremely well understood by the LLM, and generally I have found that Chat-GPT understands (by 2 or 3 orders of magnitude) better what my Auto-Generated JSON-Wrappers can do in controlling a Web-Browser than I could ever possibly hope to understand.
Though not available today, there will soon be an automatically downloadable Token-Stream (AI Embeddings) BUTTON available on my Java-Doc Pages that should hopefully make it extremely easy to post my code-base, RAG Style, to Chat-GPT and other LLM's when 'interogating' them. Presently, because my "Get Token Stream Button" does not exist yet on any of my pages, what you can do is copy-and-paste any Method-Signature from any one of these pages and then ask Chat-GPT to explain what that Browser or Java-Script Function is actually doing. It is very likely to give you some pretty neat answers.
I have found that every single one of the Domains, Types & Events which are offered by the CDP Protocol (though not documented very well by Google), are perfectly understood by the A.I. LLM - literally to the point where it does know (much better than I ever could) what my own code base actually does!
Try it out, it's a lot of fun. Note that this package and these classes were originally developed solely to be able to execute the Java-Script that a browser executes when visiting a Web-Site. Complete HTML-Page Content can be scraped (using the HTML Data-Scraping Tools in Java-HTML) off of Web-Sites that have dynamic / Java-Script Generated Content.
Conspicuous Boxed-Types Usage:
You may notice that there are many methods that have parameters which accept, for instance, anInteger, instead of a primitiveint. Just to remind the readiner, in Java Programs aBoxed Typeis a standard Java-Primitive which has been converted into an Object-Reference. The use of Boxed-Types in this code base is an easy-and-fast-way to allow for the concept of "Optional Parameters" or "Optional Field Value."
Whenever you see a method that accepts anInteger, the reason for this Parameter-Type choice is actually to allow a user to pass 'null' to it. This is a simple way to ELIDE passing any value at all to parameters which Google-Chrome would otherwise assert are "Optional." Whenever you pass 'null' to a Boxed-Types in this class, the Json-Processor will simply eliminate that Object-Property from the command altogether; and the browser will simply not receive any value for that parameter when that command is invoked.
The Java Language Specification does not have an easy or well defined means of accepting optional method parameters; so Boxed-Types and 'null' are utilized here. Note that 'null' may be passed to any Command Method-Parameter that is listed asOptionalon the Java-Doc Page description for that parameter.
Hi-Lited Source-Code:This File's Source Code:
- View Here: Torello/Browser/BrowserAPI/WebAudio.java
- Open New Browser-Tab: Torello/Browser/BrowserAPI/WebAudio.java
File Size: 49,013 Bytes Line Count: 1,206 '\n' Characters Found
Helper: Command Invocation Helpers
- View Here: WebAudio$$Commands.java
- Open New Browser-Tab: WebAudio$$Commands.java
File Size: 1,305 Bytes Line Count: 38 '\n' Characters Found
Stateless Class:This class neither contains any program-state, nor can it be instantiated. The@StaticFunctionalAnnotation may also be called 'The Spaghetti Report'.Static-Functionalclasses are, essentially, C-Styled Files, without any constructors or non-static member fields. It is a concept very similar to the Java-Bean's@StatelessAnnotation.
- 1 Constructor(s), 1 declared private, zero-argument constructor
- 3 Method(s), 3 declared static
- 8 Field(s), 8 declared static, 8 declared final
-
-
Nested Class Summary
Type Nested Classes: Types / Classes that Are Used & Exported by this Domain Modifier and Type Class Description static classWebAudio.AudioListenerProtocol object for AudioListenerstatic classWebAudio.AudioNodeProtocol object for AudioNodestatic classWebAudio.AudioParamProtocol object for AudioParamstatic classWebAudio.BaseAudioContextProtocol object for BaseAudioContextstatic classWebAudio.ContextRealtimeDataFields in AudioContext that change in real-time.Event Nested Classes: Browser Events, as Java Inner Classes, Which are Fired by this Domain Modifier and Type Class Description static classWebAudio.audioListenerCreatedNotifies that the construction of an AudioListener has finished.static classWebAudio.audioListenerWillBeDestroyedNotifies that a new AudioListener has been created.static classWebAudio.audioNodeCreatedNotifies that a new AudioNode has been created.static classWebAudio.audioNodeWillBeDestroyedNotifies that an existing AudioNode has been destroyed.static classWebAudio.audioParamCreatedNotifies that a new AudioParam has been created.static classWebAudio.audioParamWillBeDestroyedNotifies that an existing AudioParam has been destroyed.static classWebAudio.contextChangedNotifies that existing BaseAudioContext has changed some properties (id stays the same)..static classWebAudio.contextCreatedNotifies that a new BaseAudioContext has been created.static classWebAudio.contextWillBeDestroyedNotifies that an existing BaseAudioContext will be destroyed.static classWebAudio.nodeParamConnectedNotifies that an AudioNode is connected to an AudioParam.static classWebAudio.nodeParamDisconnectedNotifies that an AudioNode is disconnected to an AudioParam.static classWebAudio.nodesConnectedNotifies that two AudioNodes are connected.static classWebAudio.nodesDisconnectedNotifies that AudioNodes are disconnected.
-
Field Summary
Enumerated Strings: Like Java 'enum' Types, but Converted to Read-Only String-Lists Modifier and Type Field Description static ReadOnlyList<String>AutomationRateEnum of AudioParam::AutomationRate from the specstatic ReadOnlyList<String>ChannelCountModeEnum of AudioNode::ChannelCountMode from the specstatic ReadOnlyList<String>ChannelInterpretationEnum of AudioNode::ChannelInterpretation from the specstatic ReadOnlyList<String>ContextStateEnum of AudioContextState from the specstatic ReadOnlyList<String>ContextTypeEnum of BaseAudioContext typesEliminated Types: Removed CDP Types which Have Been Re-Mapped to Basic Java String Constants Modifier and Type Field Description static StringGraphObjectIdAn unique ID for a graph object (AudioContext, AudioNode, AudioParam) in Web Audio APIstatic StringNodeTypeEnum of AudioNode typesstatic StringParamTypeEnum of AudioParam types
-
Method Summary
WebAudio Domain Commands Script Returns Modifier and Type Method Voidstatic Script<>disable()
Disables the WebAudio domain.Voidstatic Script<>enable()
Enables the WebAudio domain and starts sending context lifetime events.WebAudio.ContextRealtimeDatastatic Script<>getRealtimeData(String contextId)
Fetch the realtime data from the registered contexts.
-
-
-
Field Detail
-
GraphObjectId
public static final java.lang.String GraphObjectId
An unique ID for a graph object (AudioContext, AudioNode, AudioParam) in Web Audio API
The TypeGraphObjectIdhas been eliminated, because it is a direct mapping to a basic Java-Type; it has no additional fields, or other distinguishing properties. Instead, this CDP defined type has been relegated to a simpleStringConstant, for documentation & reference purposes only.
The code which is generated which employs this type replaces its use with the Standard Java-Type:String
Eliminated Type- See Also:
- Constant Field Values
-
NodeType
public static final java.lang.String NodeType
Enum of AudioNode types
The TypeNodeTypehas been eliminated, because it is a direct mapping to a basic Java-Type; it has no additional fields, or other distinguishing properties. Instead, this CDP defined type has been relegated to a simpleStringConstant, for documentation & reference purposes only.
The code which is generated which employs this type replaces its use with the Standard Java-Type:String
Eliminated Type- See Also:
- Constant Field Values
-
ParamType
public static final java.lang.String ParamType
Enum of AudioParam types
The TypeParamTypehas been eliminated, because it is a direct mapping to a basic Java-Type; it has no additional fields, or other distinguishing properties. Instead, this CDP defined type has been relegated to a simpleStringConstant, for documentation & reference purposes only.
The code which is generated which employs this type replaces its use with the Standard Java-Type:String
Eliminated Type- See Also:
- Constant Field Values
-
AutomationRate
public static final ReadOnlyList<java.lang.String> AutomationRate
Enum of AudioParam::AutomationRate from the spec
String-Enumeration Type
-
ChannelCountMode
public static final ReadOnlyList<java.lang.String> ChannelCountMode
Enum of AudioNode::ChannelCountMode from the spec
String-Enumeration Type
-
ChannelInterpretation
public static final ReadOnlyList<java.lang.String> ChannelInterpretation
Enum of AudioNode::ChannelInterpretation from the spec
String-Enumeration Type
-
ContextState
public static final ReadOnlyList<java.lang.String> ContextState
Enum of AudioContextState from the spec
String-Enumeration Type
-
ContextType
public static final ReadOnlyList<java.lang.String> ContextType
Enum of BaseAudioContext types
String-Enumeration Type
-
-
Method Detail
-
disable
-
enable
-
getRealtimeData
public static Script<WebAudio.ContextRealtimeData> getRealtimeData (java.lang.String contextId)
Fetch the realtime data from the registered contexts.- Parameters:
contextId- -- Returns:
- An instance of
Script<WebAudio.ContextRealtimeData>
This script may be executed, usingScript.exec, and afterwards, aPromise<will be returnedWebAudio.ContextRealtimeData>
Finally, thePromisemay be awaited, usingPromise.await(), and the returned result of this Browser Function may be retrieved.This Browser Function'sPromisereturns:WebAudio.ContextRealtimeData(realtimeData)
-
-