Package Torello.Browser.BrowserAPI
Class CacheStorage
- java.lang.Object
-
- Torello.Browser.BrowserAPI.CacheStorage
-
public class CacheStorage extends java.lang.Object
This class was built using the Chrome Remote Dev-Tools A.P.I., which is specified by two JSON-RPC Files. These files were obtained from the Chrome Dev Tools Protocol Git Hub Page, which has a "Tip of Tree" (the latest) API-Specification Page Here: JSON-RPC Protocol Specification.
These files were converted into this Java-Browser (CDP) Library. The intention is to have them function in a similar fasion to the Node.js Tool known as 'Puppeteer', Microsoft's 'Playwright' and of course the Main-Stay 'Selenium.' The Java-HTML JAR Library merely implements the Java Types & Commands defined by Google's DevTools Protocol.
🧠View the Google CDP API:
[No Description Provided by Google]
The top-level description and explanation for this class (this comment, at the top this Java-Doc Page) is repeated, verbatim, across all of the domain classes which comprise Google's CDP API.This class is intended to be used with a Browser Instance
These methods have been tested, to some degree, using Google Chrome. In order to use this class you must start a web-browser instance and make a connection to the browser using aRemote Debugging Port. Google-Corporation is the developer of this API, but any browser which accepts a Remote Debug Port Connection over Web-Sockets.
Google-Chrome was used during the development process of the classes in this particular package. Lately, it has been asserted Microsoft has switched to using the Chrome Browser-Engine for its Microsoft Edge Internal Code-Base. Therefore, there may some functionality available when running the methods in this class with Microsoft-Edge.
Check whether the your Web-Browser will allow itself to be driven by theWeb-Socket RDP-Port 9223. See the examples available in packageTorello.Browserto undertand how to build aPageConnandBrowserConnWeb-Socket Connection, and how to build aWebSocketSenderinstance in order to execute the methods in this class.
Web-Socket & JSON API:
Every one of the methods that reside in this class are designed to do nothing more than:- Accept Parameters from the User, and "Marshall Them" into a Valid JSON-Request
- Transmit the Marshalled Request-JSON to a Headless Web-Browser over a Web-Socket Connection
- Receive BOTH that Command-Results AND any Browser Event-Firings from the Web-Socket
- Parse JSON Method-Results and Browser-Event Firings, and Subsequently Convert them to Standard Java-Types
- Report these Method-Results and Browser-Events to the User via a User-Registered, Event-Listener (Events) or a Promise Object (Command Responses / Results)
Unlike the bulk of the Java HTML JAR Library, there is very little native Java-Code, and very little testing that may be done on any of the classes & methods in this package. The code inside these classes does nothing more than marshall-and-unmarshall Java-Types into Json-Requests (and vice-versa). The Java-Script & Browser modules inside of a Google-Chrome instance are, theoretically, handling these requests, and returning their results (or events) over the Web-Socket Connection.
It has been asserted (by Google Chrome Developers) that some of these methods are only "partially working" or "experimental".
Asking Chat-GPT for Help:
The LLM otherwise known as "Chat-GPT" does, indeed, have an expert level of knowledge about the "Remote DevTools Protocol". The API that theChrome DevTools Protocl (CDP)exports is extremely well understood by the LLM, and generally I have found that Chat-GPT understands (by 2 or 3 orders of magnitude) better what my Auto-Generated JSON-Wrappers can do in controlling a Web-Browser than I could ever possibly hope to understand.
Though not available today, there will soon be an automatically downloadable Token-Stream (AI Embeddings) BUTTON available on my Java-Doc Pages that should hopefully make it extremely easy to post my code-base, RAG Style, to Chat-GPT and other LLM's when 'interogating' them. Presently, because my "Get Token Stream Button" does not exist yet on any of my pages, what you can do is copy-and-paste any Method-Signature from any one of these pages and then ask Chat-GPT to explain what that Browser or Java-Script Function is actually doing. It is very likely to give you some pretty neat answers.
I have found that every single one of the Domains, Types & Events which are offered by the CDP Protocol (though not documented very well by Google), are perfectly understood by the A.I. LLM - literally to the point where it does know (much better than I ever could) what my own code base actually does!
Try it out, it's a lot of fun. Note that this package and these classes were originally developed solely to be able to execute the Java-Script that a browser executes when visiting a Web-Site. Complete HTML-Page Content can be scraped (using the HTML Data-Scraping Tools in Java-HTML) off of Web-Sites that have dynamic / Java-Script Generated Content.
Conspicuous Boxed-Types Usage:
You may notice that there are many methods that have parameters which accept, for instance, anInteger, instead of a primitiveint. Just to remind the readiner, in Java Programs aBoxed Typeis a standard Java-Primitive which has been converted into an Object-Reference. The use of Boxed-Types in this code base is an easy-and-fast-way to allow for the concept of "Optional Parameters" or "Optional Field Value."
Whenever you see a method that accepts anInteger, the reason for this Parameter-Type choice is actually to allow a user to pass 'null' to it. This is a simple way to ELIDE passing any value at all to parameters which Google-Chrome would otherwise assert are "Optional." Whenever you pass 'null' to a Boxed-Types in this class, the Json-Processor will simply eliminate that Object-Property from the command altogether; and the browser will simply not receive any value for that parameter when that command is invoked.
The Java Language Specification does not have an easy or well defined means of accepting optional method parameters; so Boxed-Types and 'null' are utilized here. Note that 'null' may be passed to any Command Method-Parameter that is listed asOptionalon the Java-Doc Page description for that parameter.
Hi-Lited Source-Code:This File's Source Code:
- View Here: Torello/Browser/BrowserAPI/CacheStorage.java
- Open New Browser-Tab: Torello/Browser/BrowserAPI/CacheStorage.java
File Size: 22,351 Bytes Line Count: 563 '\n' Characters Found
Helper: Command Invocation Helpers
- View Here: CacheStorage$$Commands.java
- Open New Browser-Tab: CacheStorage$$Commands.java
File Size: 4,350 Bytes Line Count: 100 '\n' Characters Found
Stateless Class:This class neither contains any program-state, nor can it be instantiated. The@StaticFunctionalAnnotation may also be called 'The Spaghetti Report'.Static-Functionalclasses are, essentially, C-Styled Files, without any constructors or non-static member fields. It is a concept very similar to the Java-Bean's@StatelessAnnotation.
- 1 Constructor(s), 1 declared private, zero-argument constructor
- 5 Method(s), 5 declared static
- 2 Field(s), 2 declared static, 2 declared final
-
-
Nested Class Summary
Type Nested Classes: Types / Classes that Are Used & Exported by this Domain Modifier and Type Class Description static classCacheStorage.CacheCache identifier.static classCacheStorage.CachedResponseCached responsestatic classCacheStorage.DataEntryData entry.static classCacheStorage.Header[No Description Provided by Google]Command-Returns Nested Classes: Domain-Commands with Multiple Return-Values, and a Dedicated Inner-Class Modifier and Type Class Description static classCacheStorage.requestEntries$$RETRequests data from cache.
-
Field Summary
Enumerated Strings: Like Java 'enum' Types, but Converted to Read-Only String-Lists Modifier and Type Field Description static ReadOnlyList<String>CachedResponseTypetype of HTTP response cachedEliminated Types: Removed CDP Types which Have Been Re-Mapped to Basic Java String Constants Modifier and Type Field Description static StringCacheIdUnique identifier of the Cache object.
-
Method Summary
CacheStorage Domain Commands Script Returns Modifier and Type Method Voidstatic Script<>deleteCache(String cacheId)
Deletes a cache.Voidstatic Script<>deleteEntry(String cacheId, String request)
Deletes a cache entry.CacheStorage.CachedResponsestatic Script<>requestCachedResponse(String cacheId, String requestURL, CacheStorage.Header[] requestHeaders)
Fetches cache entry.CacheStorage.Cache[]static Script<>requestCacheNames(String securityOrigin, String storageKey, Storage.StorageBucket storageBucket)
Requests cache names.CacheStorage.requestEntries$$RETstatic Script<>requestEntries(String cacheId, Integer skipCount, Integer pageSize, String pathFilter)
Requests data from cache.
-
-
-
Field Detail
-
CacheId
public static final java.lang.String CacheId
Unique identifier of the Cache object.
The TypeCacheIdhas been eliminated, because it is a direct mapping to a basic Java-Type; it has no additional fields, or other distinguishing properties. Instead, this CDP defined type has been relegated to a simpleStringConstant, for documentation & reference purposes only.
The code which is generated which employs this type replaces its use with the Standard Java-Type:String
Eliminated Type- See Also:
- Constant Field Values
-
CachedResponseType
public static final ReadOnlyList<java.lang.String> CachedResponseType
type of HTTP response cached
String-Enumeration Type
-
-
Method Detail
-
deleteCache
public static Script<java.lang.Void> deleteCache(java.lang.String cacheId)
Deletes a cache.- Parameters:
cacheId- Id of cache for deletion.- Returns:
- An instance of
Script<Void>
ThisScriptinstance must be executed before the browser receives the invocation-request.This Browser-Function does not have a return-value. You may choose to await thePromise<Void>to ensure that the Browser Function has run to completion.
-
deleteEntry
public static Script<java.lang.Void> deleteEntry(java.lang.String cacheId, java.lang.String request)
Deletes a cache entry.- Parameters:
cacheId- Id of cache where the entry will be deleted.request- URL spec of the request.- Returns:
- An instance of
Script<Void>
ThisScriptinstance must be executed before the browser receives the invocation-request.This Browser-Function does not have a return-value. You may choose to await thePromise<Void>to ensure that the Browser Function has run to completion.
-
requestCacheNames
public static Script<CacheStorage.Cache[]> requestCacheNames (java.lang.String securityOrigin, java.lang.String storageKey, Storage.StorageBucket storageBucket)
Requests cache names.- Parameters:
securityOrigin- At least and at most one of securityOrigin, storageKey, storageBucket must be specified. Security origin.
OPTIONALstorageKey- Storage key.
OPTIONALstorageBucket- Storage bucket. If not specified, it uses the default bucket.
OPTIONAL- Returns:
- An instance of
Script<CacheStorage.Cache[]>
This script may be executed, usingScript.exec, and afterwards, aPromise<will be returnedCacheStorage.Cache[]>
Finally, thePromisemay be awaited, usingPromise.await(), and the returned result of this Browser Function may be retrieved.This Browser Function'sPromisereturns:CacheStorage.Cache[] (caches)
Caches for the security origin.
-
requestCachedResponse
public static Script<CacheStorage.CachedResponse> requestCachedResponse (java.lang.String cacheId, java.lang.String requestURL, CacheStorage.Header[] requestHeaders)
Fetches cache entry.- Parameters:
cacheId- Id of cache that contains the entry.requestURL- URL spec of the request.requestHeaders- headers of the request.- Returns:
- An instance of
Script<CacheStorage.CachedResponse>
This script may be executed, usingScript.exec, and afterwards, aPromise<will be returnedCacheStorage.CachedResponse>
Finally, thePromisemay be awaited, usingPromise.await(), and the returned result of this Browser Function may be retrieved.This Browser Function'sPromisereturns:CacheStorage.CachedResponse(response)
Response read from the cache.
-
requestEntries
public static Script<CacheStorage.requestEntries$$RET> requestEntries (java.lang.String cacheId, java.lang.Integer skipCount, java.lang.Integer pageSize, java.lang.String pathFilter)
Requests data from cache.- Parameters:
cacheId- ID of cache to get entries from.skipCount- Number of records to skip.
OPTIONALpageSize- Number of records to fetch.
OPTIONALpathFilter- If present, only return the entries containing this substring in the path
OPTIONAL- Returns:
- An instance of
Script<CacheStorage.requestEntries$$RET>
This script may be executed, usingScript.exec, and afterwards, aPromise<will be returnedCacheStorage.requestEntries$$RET>
Finally, thePromisemay be awaited, usingPromise.await(), and the returned result of this Browser Function may be retrieved.This Browser Function'sPromisereturns:CacheStorage.requestEntries$$RETA dedicated return type implies that the browser may return more than 1 datum
-
-