Upload a file to xtk:fileRes via SOAP or other HTTP request?

Forum|Forum|5 years ago
September 27, 2020
2 replies
2828 views

Here is the deal: we don't have anything in ACC for any kind of DevOps or CI/CD stuff. But we have a possibility to do SOAP calls and several other JSP endpoints are accessible also. Frankly better than nothing.

But! There is one task which seem to be impossible to have automated without injecting custom schema and JS library: upload a file to the instance and link it to the xtk:fileRes resource.

What I've discovered so far:

1. What Client console does?

One can use traceviewer to see which calls Client Console performs. Unfortunately, this is what it shows right after Console checks whether the file already exists and before calling PostUpload:

In other words: nothing helpful. Using traffic sniffer it became clear that Client Console actually does the same that all WebApps do to upload a file, see (2) below.

2. WebApp could also upload a file to the instance disk. How it works?

It's pretty simple and straightforward. In fact, when uploading using WebApp, the browser sends POST request to uploadFile.jsp, which, in return, responds with a bit of HTML and JS code, where all the details of the uploaded file are included. But to use this for automation tools, one will have to a) perform the request with required fields inside, b) parse the output. This second part is not so easy because you really have to parse HTML, get the JS from it and then parse JS. (Or you can use regexes to grab the strings, but it's a duct tape, really)

3. Inject custom stuff into ACC to have your automation working

For sure, custom schema can be built exposing custom SOAP method, and custom JS can be written to handle this method and use ACC JS API (like File()) to store uploaded file on disk. But, no. Good automation is the automation which might be thrown away at any time with no need to change anything in the target system. In ideal world, target system should know nothing about automation system. (unless target system doesn't have built-in APIs for external management)

Short conclusion: there is no easy way to pick a file from your local drive and put in into ACC without Client Console.

Adobe, would you please be so kind and share your thoughts on this? Maybe there is a solution hidden somewhere without proper documentation?

Or maybe anyone has a solution? Please? 😉

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

Jonathon_wodnicki

Community Advisor

Hi,

Follow these steps:

POST the file to /nl/jsp/uploadFile.jsp, using content type multipart/form-data. Ignore the response, there's nothing useful in it.
Call SOAPAction: xtk:fileRes#PostUpload with this entity content: <fileRes md5="<file's md5 hash>" originalName="<original filename since it becomes md5 on disk>" useMd5AsFilename="true" publish="true" storageType="5" xtkschema="xtk:fileRes" xmlns="urn:xtk:fileRes" />

Might need to create the xtk:fileRes ahead of the PostUpload call using xtk:persist#Write, give it a shot.

Thanks,

-Jon

Y

yetanother_andreyAuthor

Level 3

Yes, console does this. But this does not work as expected outside the console.

Console does this after PostUpload:

<SOAP-ENV:Envelope xmlns:xsd='http://www.w3.org/2001/XMLSchema' xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance' xmlns:ns='urn:xtk:persist' xmlns:SOAP-ENV='http://schemas.xmlsoap.org/soap/envelope/'>
    <SOAP-ENV:Body>
        <Write xmlns='urn:xtk:persist' SOAP-ENV:encodingStyle='http://schemas.xmlsoap.org/soap/encoding/'>
            <__sessiontoken xsi:type='xsd:string'></__sessiontoken>
            <domDoc xsi:type='ns:Element' SOAP-ENV:encodingStyle='http://xml.apache.org/xml-soap/literalxml'>
                <fileRes _operation="update" codepage="0" contentType="application/x-javascript" fileName="/usr/local/neolane/nl6/var/res/customer_mkt_dev1/sec.js" id="964763428" loaded="1" md5="cc3d7f57d9f47e3c9a28f27385ea030b" name="sec.js" userContentType="20" xtkschema="xtk:fileRes">
                    <history _operation="insert" activityType="2" description="Updating file 'D:\Documents\Seafile\B2CMA\Dev\blackhole\sec.js' on the server" id="964763488" lastModified="2020-09-30 12:38:12.590Z" md5="cc3d7f57d9f47e3c9a28f27385ea030b" modifiedBy-id="361091" xtkschema="xtk:fileResHistory">
                        <modifiedBy _cs="" />
                    </history>
                </fileRes>
            </domDoc>
        </Write>
    </SOAP-ENV:Body>
</SOAP-ENV:Envelope>

I've added similar call to my python script:

last_fileRes_update_payload = f"""
<SOAP-ENV:Envelope xmlns:xsd='http://www.w3.org/2001/XMLSchema' xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance' xmlns:ns='urn:xtk:persist' xmlns:SOAP-ENV='http://schemas.xmlsoap.org/soap/envelope/'>
    <SOAP-ENV:Body>
        <Write xmlns='urn:xtk:persist' SOAP-ENV:encodingStyle='http://schemas.xmlsoap.org/soap/encoding/'>
            <__sessiontoken xsi:type='xsd:string'></__sessiontoken>
            <domDoc xsi:type='ns:Element' SOAP-ENV:encodingStyle='http://xml.apache.org/xml-soap/literalxml'>
                <fileRes _operation="update" codepage="0" contentType="image/png" fileName="/usr/local/neolane/nl6/var/res/customer_mkt_dev1/{file_md5}.png" loaded="1" md5="{file_md5}" name="{file_name}" userContentType="20" internalName="testFileMd5" _key="@internalName" xtkschema="xtk:fileRes">
                    <history _operation="insert" activityType="2" description="Updating file 'D:\Documents\Seafile\B2CMA\Dev\per task\librarian upload file\{file_name}' on the server" md5="{file_md5}" xtkschema="xtk:fileResHistory"/>
                </fileRes>
            </domDoc>
        </Write>
    </SOAP-ENV:Body>
</SOAP-ENV:Envelope>
"""
last_fileRes_update_headers = {
    'Content-Type': 'application/soap+xml',
    'action': 'xtk:persist#Write',
    'SOAPAction': 'xtk:persist#Write'
}
last_fileRes_update_response = session.post(f"{ac_url}/nl/jsp/soaprouter.jsp", data=last_fileRes_update_payload, headers=last_fileRes_update_headers)
print(last_fileRes_update_response.text)

And got response:

<?xml version='1.0'?>
<SOAP-ENV:Envelope xmlns:xsd='http://www.w3.org/2001/XMLSchema' xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance' xmlns:ns='urn:wpp:default' xmlns:SOAP-ENV='http://schemas.xmlsoap.org/soap/envelope/'>
    <SOAP-ENV:Body>
        <WriteResponse xmlns='urn:wpp:default' SOAP-ENV:encodingStyle='http://schemas.xmlsoap.org/soap/encoding/'></WriteResponse>
    </SOAP-ENV:Body>
</SOAP-ENV:Envelope>

Furthermore, I see that file _was_ uploaded and stored on disk:

-rw-r--r-- 1 neolane neolane 950 Oct 22 08:59 /usr/local/neolane/nl6/var/res/customer_mkt_dev1/65e5f1e8970e5de6446011d3e1228fd6.png

And also, @fileName is populated with correct full file path.

But in the console:

If "Publish now" is clicked, console sends this request:

<?xml version='1.0'?>
<SOAP-ENV:Envelope xmlns:xsd='http://www.w3.org/2001/XMLSchema' xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance' xmlns:ns='urn:xtk:fileRes' xmlns:SOAP-ENV='http://schemas.xmlsoap.org/soap/envelope/'>
    <SOAP-ENV:Body>
        <PublishIfNeeded xmlns='urn:xtk:fileRes' SOAP-ENV:encodingStyle='http://schemas.xmlsoap.org/soap/encoding/'>
            <__sessiontoken xsi:type='xsd:string'></__sessiontoken>
            <param xsi:type='xsd:element'>
                <fileRes _cs="some_ext_logo.png" alt="" codepage="0" contentType="image/png" fileName="/usr/local/neolane/nl6/var/res/customer_mkt_dev1/65e5f1e8970e5de6446011d3e1228fd6.png" height="0" id="982178670" internalName="testFileMd5" label="some_ext_logo.png" loaded="1" md5="65e5f1e8970e5de6446011d3e1228fd6" name="" nature="" originalName="" publish="0" storageType="5" useMd5AsFilename="1" userContentType="0" version="" width="0" />
            </param>
        </PublishIfNeeded>
    </SOAP-ENV:Body>
</SOAP-ENV:Envelope>

And it fails!

<?xml version='1.0'?>
<SOAP-ENV:Envelope xmlns:xsd='http://www.w3.org/2001/XMLSchema' xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance' xmlns:SOAP-ENV='http://schemas.xmlsoap.org/soap/envelope/'>
    <SOAP-ENV:Body>
        <SOAP-ENV:Fault>
            <faultcode>SOAP-ENV:Server</faultcode>
            <faultstring xsi:type='xsd:string'>SOP-330011 Error while executing the method 'PublishIfNeeded' of service 'xtk:fileRes'.</faultstring>
            <detail xsi:type='xsd:string'>XSV-350059 Unable to upload the images to the tracking servers.</detail>
        </SOAP-ENV:Fault>
    </SOAP-ENV:Body>
</SOAP-ENV:Envelope>