+ Start a Discussion
Daniel StrongDaniel Strong 

How do I properly use edgemarts in Salesforce Wave dataflows?

I have a wave dataset called "CustomerData" which is populated from a salesforce custom object. What I want to do is take a snapshot of this custom object, and append it to the dataset (with today's date) as a part of the dataflow.
The problem I run in to is that I need to do an "edgemart" action followed by an "append" action to actually add data on to the exisitng dataset. However whenever I do this in my dataflow:
"ExistingCustomerDataSnapshots": {
          "action": "edgemart",
          "parameters": {
             "alias": "CustomerData"
          }
       },


I get this error when I run it:
 
Error executing node ExistingCustomerDataSnapshots: Error in GetEdgemartCurrentData for edgemart CustomerData: No edgemarts found with specified URL:esObject/edgemart?current=true&alias=CustomerData

I am certain the dataset exists and that the name is correct.

Is there something I need to do additional to be able to use edgemarts besides just adding the action to the dataflow json?
Guilherme Baccas 18Guilherme Baccas 18
Hi Daniel, 
This already happend with me, but because the name Dataset was wrong or no there.

Do you can send all your flow for here?

Why do not you do it in the same stream that you populate the dataset "CustomerData" the salesforce object?

​You can entry in contact with me: guilherme.baccas@outlook.com



 
Daniel StrongDaniel Strong
The goal is to do it all in the same dataflow. I want to capture "snapshots" of this CustomerData object so I can compare the data over time. This is the entire dataflow I am trying to make work. The "CustomerData" dataset already exists from running this flow without the append stuff (just the digest and register actions). I think there might be some permission related reason why the CustomerData dataset isn't visible. But I can't seem to figure out what that permission might be.
 
{
   "101": {
      "action": "sfdcDigest",
      "parameters": {
         "fields": [
            {
               "name": "Name"
            },
            {
               "name": "Id"
            }
         ],
         "object": "arv__CustomerData__c"
      }
   },
   "CustomerDataSnapshot": {
      "action": "computeExpression",
      "parameters": {
         "source": "101",
         "mergeWithSource": true,
         "computedFields": [
            {
               "name": "Snapshot_Date",
               "type": "Date",
               "label": "Snapshot Date",
               "saqlExpression": "now()",
               "format": "MM/dd/yyyy"
            }
         ]
      }
   },
   "ExistingCustomerDataSnapshots": {
      "action": "edgemart",
      "parameters": {
         "alias": "CustomerData"
      }
   },
   "CombinedCustomerData": {
      "action": "append",
      "parameters": {
         "sources": [
            "ExistingCustomerDataSnapshots",
            "CustomerDataSnapshot"
         ]
      }
   },
   "RegisterCustomerData": {
      "action": "sfdcRegister",
      "parameters": {
         "alias": "CustomerData",
         "name": "CustomerData",
         "source": "CombinedCustomerData"
      }
   }
}

 
Guilherme Baccas 18Guilherme Baccas 18
Ok, your code is correct.
I tested this (esObject/edgemart?) on a return request via Rest. It return all datasets. You need check something:
This flow is for creat this dataset "CustomerData", or this dataset already exist? Because this erro indicate that dataset not exist. You need have to make sure that before ran this flow the dataset already is create.
Daniel StrongDaniel Strong
FYI for anyone else that comes across this.

This was due to a bug in salesforce with namespaced orgs. I believe the issue was fixed in winter 17, but I am still keeping the namespace off of my development org.
Rahul Sangwan7341Rahul Sangwan7341
{
  "Extract_PricebookEntry": {
    "action": "sfdcDigest",
    "parameters": {
      "SFDCtoken": "SFDCtoken",
      "maxAllowedOffset": 1500,
      "fields": [
        {
          "name": "Id"
        },
        {
          "name": "Product2Id"
        }
      ],
      "concurrentBatches": 12,
      "object": "PricebookEntry"
    }
  },
  "augment_Payment__c_Opportunity_2": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left": "sfdcDigest_Payment__c_2",
      "left_key": [
        "Opportunity__c"
      ],
      "right_select": [
        "Name",
        "Id",
        "AccountId",
        "OwnerId"
      ],
      "right": "sfdcDigest_Opportunity_2",
      "relationship": "Opportunity__c"
    }
  },
  "augment_Payment__c_Opportunity_0": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left": "sfdcDigest_Payment__c_0",
      "left_key": [
        "Opportunity__c"
      ],
      "right_select": [
        "Amount",
        "IsClosed",
        "Name",
        "Id",
        "AccountId",
        "OwnerId"
      ],
      "right": "sfdcDigest_Opportunity_0",
      "relationship": "Opportunity__c"
    }
  },
  "sfdcDigest_Payment__c_0": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Donor_Code__c"
        },
        {
          "name": "Name"
        },
        {
          "name": "Payment_Amount__c"
        },
        {
          "name": "Id"
        },
        {
          "name": "Opportunity__c"
        }
      ],
      "object": "Payment__c"
    }
  },
  "sfdcDigest_User": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "IsActive"
        },
        {
          "name": "Name"
        },
        {
          "name": "Id"
        }
      ],
      "object": "User"
    }
  },
  "Join_OpportunityLineItemPricebookEntry": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left_key": [
        "PricebookEntryId"
      ],
      "left": "Extract_OpportunityLineItem",
      "right_select": [
        "Product2Id"
      ],
      "right": "Extract_PricebookEntry",
      "relationship": "Pricebook"
    }
  },
  "Extract_Opportunity": {
    "action": "sfdcDigest",
    "parameters": {
      "SFDCtoken": "SFDCtoken",
      "maxAllowedOffset": 1500,
      "fields": [
        {
          "name": "Id"
        },
        {
          "name": "AccountId"
        },
        {
          "name": "OwnerId"
        },
        {
          "name": "Name"
        },
        {
          "name": "StageName"
        },
        {
          "name": "LeadSource"
        },
        {
          "name": "IsWon"
        },
        {
          "name": "Type"
        },
        {
          "name": "IsClosed"
        },
        {
          "name": "ForecastCategory"
        },
        {
          "name": "ForecastCategoryName"
        },
        {
          "name": "CreatedDate"
        },
        {
          "name": "CloseDate"
        },
        {
          "name": "Amount"
        },
        {
          "name": "CreatedById"
        }
      ],
      "concurrentBatches": 12,
      "object": "Opportunity"
    }
  },
  "Join_AccountOwner": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left_key": [
        "OwnerId"
      ],
      "left": "Extract_Account",
      "right_select": [
        "Name",
        "Username"
      ],
      "right": "Extract_User",
      "relationship": "Owner",
      "operation": "LookupMultiValue"
    }
  },
  "sfdcDigest_Account": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Name"
        },
        {
          "name": "AccountSource"
        },
        {
          "name": "Type"
        },
        {
          "name": "Id"
        }
      ],
      "object": "Account"
    }
  },
  "augment_User": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left": "augment_Case_Account",
      "left_key": [
        "OwnerId"
      ],
      "right_select": [
        "IsActive",
        "Name"
      ],
      "right": "sfdcDigest_User",
      "relationship": "OwnerId"
    }
  },
  "Extract_Product": {
    "action": "sfdcDigest",
    "parameters": {
      "SFDCtoken": "SFDCtoken",
      "maxAllowedOffset": 1500,
      "fields": [
        {
          "name": "Id"
        },
        {
          "name": "ProductCode"
        },
        {
          "name": "Name"
        },
        {
          "name": "Family"
        }
      ],
      "concurrentBatches": 12,
      "object": "Product2"
    }
  },
  "sfdcDigest_Payment__c_2": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Donor_Code__c"
        },
        {
          "name": "Payment_Amount__c"
        },
        {
          "name": "Id"
        },
        {
          "name": "Opportunity__c"
        }
      ],
      "object": "Payment__c"
    }
  },
  "Extract_User": {
    "action": "sfdcDigest",
    "parameters": {
      "SFDCtoken": "SFDCtoken",
      "chunkSize": 1500,
      "maxAllowedOffset": 1500,
      "fields": [
        {
          "name": "Id"
        },
        {
          "name": "Username"
        },
        {
          "name": "Name"
        },
        {
          "name": "UserRoleId"
        },
        {
          "name": "ManagerId"
        }
      ],
      "concurrentBatches": 12,
      "object": "User"
    }
  },
  "sfdcDigest_User_1": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Name"
        },
        {
          "name": "Id"
        }
      ],
      "object": "User"
    }
  },
  "register_Payment with Donor_0": {
    "action": "sfdcRegister",
    "parameters": {
      "name": "Payment with Donor",
      "alias": "Payment_with_Donor",
      "source": "augment_User_0"
    }
  },
  "sfdcDigest_User_2": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Id"
        },
        {
          "name": "Name"
        }
      ],
      "object": "User"
    }
  },
  "Join_OpportunityOwner": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left_key": [
        "OwnerId"
      ],
      "left": "Join_OpportunityAccount",
      "right_select": [
        "Name",
        "Username"
      ],
      "right": "Extract_User",
      "relationship": "Owner",
      "operation": "LookupMultiValue"
    }
  },
  "sfdcDigest_User_0": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Name"
        },
        {
          "name": "Id"
        }
      ],
      "object": "User"
    }
  },
  "Join_OpportunityLineItemPricebookEntryProduct": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left_key": [
        "Pricebook.Product2Id"
      ],
      "left": "Join_OpportunityLineItemPricebookEntry",
      "right_select": [
        "ProductCode",
        "Name",
        "Family"
      ],
      "right": "Extract_Product",
      "relationship": "Product"
    }
  },
  "Register_OpportunityProducts": {
    "action": "sfdcRegister",
    "parameters": {
      "SFDCtoken": "SFDCtoken",
      "rowLevelSecurityFilter": "",
      "name": "Products Opportunities",
      "alias": "products_opportunities",
      "source": "Join_OpportunityOpportunityLineItemPricebookEntryProduct"
    }
  },
  "augment_Account_User_1": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left": "sfdcDigest_Account_1",
      "left_key": [
        "OwnerId"
      ],
      "right_select": [
        "Name",
        "Id"
      ],
      "right": "sfdcDigest_User_1",
      "relationship": "OwnerId"
    }
  },
  "sfdcDigest_Account_0": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Unique_Id__c"
        },
        {
          "name": "Name"
        },
        {
          "name": "Id"
        }
      ],
      "object": "Account"
    }
  },
  "Join_OpportunityAccount": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left_key": [
        "AccountId"
      ],
      "left": "Extract_Opportunity",
      "right_select": [
        "Name",
        "Type",
        "Industry",
        "BillingCountry",
        "BillingState",
        "AccountSource",
        "OwnerId",
        "Owner.Name"
      ],
      "right": "Join_AccountOwner",
      "relationship": "Account",
      "operation": "LookupMultiValue"
    }
  },
  "sfdcDigest_Account_2": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Name"
        },
        {
          "name": "Unique_Id__c"
        },
        {
          "name": "Id"
        }
      ],
      "object": "Account"
    }
  },
  "sfdcDigest_Account_1": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Name"
        },
        {
          "name": "Unique_Id__c"
        },
        {
          "name": "OwnerId"
        }
      ],
      "object": "Account"
    }
  },
  "register_Donor Data_1": {
    "action": "sfdcRegister",
    "parameters": {
      "name": "Donor Data",
      "alias": "Donor_Data",
      "source": "augment_Account_User_1"
    }
  },
  "augment_Account_2": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left": "augment_Payment__c_Opportunity_2",
      "left_key": [
        "Opportunity__c.AccountId"
      ],
      "right_select": [
        "Name",
        "Unique_Id__c",
        "Id"
      ],
      "right": "sfdcDigest_Account_2",
      "relationship": "Opportunity__c.AccountId"
    }
  },
  "augment_Account_0": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left": "augment_Payment__c_Opportunity_0",
      "left_key": [
        "Opportunity__c.AccountId"
      ],
      "right_select": [
        "Unique_Id__c",
        "Name"
      ],
      "right": "sfdcDigest_Account_0",
      "relationship": "Opportunity__c.AccountId"
    }
  },
  "augment_User_2": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left": "augment_Account_2",
      "left_key": [
        "Opportunity__c.OwnerId"
      ],
      "right_select": [
        "Id",
        "Name"
      ],
      "right": "sfdcDigest_User_2",
      "relationship": "Opportunity__c.OwnerId"
    }
  },
  "augment_Case_Account": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left": "sfdcDigest_Case",
      "left_key": [
        "AccountId"
      ],
      "right_select": [
        "Name",
        "AccountSource",
        "Type"
      ],
      "right": "sfdcDigest_Account",
      "relationship": "AccountId"
    }
  },
  "augment_User_0": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left": "augment_Account_0",
      "left_key": [
        "Opportunity__c.OwnerId"
      ],
      "right_select": [
        "Name",
        "Id"
      ],
      "right": "sfdcDigest_User_0",
      "relationship": "Opportunity__c.OwnerId"
    }
  },
  "Extract_Account": {
    "action": "sfdcDigest",
    "parameters": {
      "SFDCtoken": "SFDCtoken",
      "fields": [
        {
          "name": "Id"
        },
        {
          "name": "Name"
        },
        {
          "name": "OwnerId"
        },
        {
          "name": "AccountSource"
        },
        {
          "name": "Type"
        },
        {
          "name": "Industry"
        },
        {
          "name": "BillingCountry"
        },
        {
          "name": "BillingState"
        },
        {
          "name": "CreatedDate"
        },
        {
          "name": "LastModifiedDate"
        }
      ],
      "object": "Account"
    }
  },
  "Extract_OpportunityLineItem": {
    "action": "sfdcDigest",
    "parameters": {
      "SFDCtoken": "SFDCtoken",
      "maxAllowedOffset": 1500,
      "fields": [
        {
          "name": "OpportunityId"
        },
        {
          "name": "ProductCode"
        },
        {
          "name": "ListPrice"
        },
        {
          "name": "Quantity"
        },
        {
          "name": "TotalPrice"
        },
        {
          "name": "PricebookEntryId"
        }
      ],
      "concurrentBatches": 12,
      "object": "OpportunityLineItem"
    }
  },
  "Join_OpportunityOpportunityLineItemPricebookEntryProduct": {
    "action": "augment",
    "parameters": {
      "right_key": [
        "Id"
      ],
      "left_key": [
        "OpportunityId"
      ],
      "left": "Join_OpportunityLineItemPricebookEntryProduct",
      "right_select": [
        "Name",
        "StageName",
        "CloseDate",
        "IsWon",
        "Type",
        "IsClosed",
        "LeadSource",
        "ForecastCategory",
        "ForecastCategoryName",
        "CreatedDate",
        "AccountId",
        "Account.Name",
        "Account.OwnerId",
        "Account.Type",
        "Account.Industry",
        "Account.BillingCountry",
        "Account.BillingState",
        "Account.AccountSource",
        "Account.Owner.Name",
        "OwnerId",
        "Owner.Name"
      ],
      "right": "Join_OpportunityOwner",
      "relationship": "Opportunity"
    }
  },
  "sfdcDigest_Case": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Id"
        },
        {
          "name": "CaseNumber"
        },
        {
          "name": "Origin"
        },
        {
          "name": "Reason"
        },
        {
          "name": "Type"
        },
        {
          "name": "AccountId"
        },
        {
          "name": "OwnerId"
        }
      ],
      "object": "Case"
    }
  },
  "sfdcDigest_Opportunity_2": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Name"
        },
        {
          "name": "Id"
        },
        {
          "name": "AccountId"
        },
        {
          "name": "OwnerId"
        }
      ],
      "object": "Opportunity"
    }
  },
  "register_Salesforce Payments_2": {
    "action": "sfdcRegister",
    "parameters": {
      "name": "Salesforce Payments",
      "alias": "Salesforce_Payments",
      "source": "augment_User_2"
    }
  },
  "register_Cases with Accounts": {
    "action": "sfdcRegister",
    "parameters": {
      "name": "Cases with Accounts",
      "alias": "Cases_with_Accounts",
      "source": "augment_User"
    }
  },
  "sfdcDigest_Opportunity_0": {
    "action": "sfdcDigest",
    "parameters": {
      "fields": [
        {
          "name": "Amount"
        },
        {
          "name": "IsClosed"
        },
        {
          "name": "Name"
        },
        {
          "name": "Id"
        },
        {
          "name": "AccountId"
        },
        {
          "name": "OwnerId"
        }
      ],
      "object": "Opportunity"
    }
  },
  "Register_Opportunity": {
    "action": "sfdcRegister",
    "parameters": {
      "SFDCtoken": "SFDCtoken",
      "rowLevelSecurityFilter": "",
      "name": "Opportunities",
      "alias": "opportunities",
      "source": "Join_OpportunityOwner"
    }
  },
  "New_Payment_Ext": {
    "action": "edgemart",
    "parameters": {
      "alias": "New_Payment_CSV"
    }
  },
  "New_Payment_SF": {
    "action": "edgemart",
    "parameters": {
      "alias": "Salesforce_Payments"
    }
  },
  "Append_Payments_All": {
    "action": "append",
    "parameters": {
      "sources": [
        "New_Payment_Ext",
        "New_Payment_SF"
      ]
    }
  }
}

Guys, does anybody has idea, what is wrong in my DDL.
while ruuning the Dataflow, i am getting below error:
Something went wrong while executing the Append_Payments_All node: Field [Payment_Amount] is missing in 1 out of 2 inputs Field [Opportunity__c.AccountId.Name] is missing in 1 out of 2 inputs Field [Opportunity__c.OwnerId.Name] is missing in 1 out of 2 inputs Field [Donor_Code__c] is missing in 1 out of 2 inputs Field [Opportunity_c_AccountId_Name] is missing in 1 out of 2 inputs Field [Opportunity_c_OwnerId] is missing in 1 out of 2 inputs Field [Opportunity__c.OwnerId] is missing in 1 out of 2 inputs Field [Opportunity_c_IsClosed] is missing in 1 out of 2 inputs Field [Opportunity_c_OwnerId_Name] is missing in 1 out of 2 inputs Field [Opportunity__c] is missing in 1 out of 2 inputs Field [Name] is missing in 1 out of 2 inputs Field [Opportunity__c.Id] is missing in 1 out of 2 inputs Field [Opportunity_c_Name] is missing in 1 out of 2 inputs Field [Opportunity_c_OwnerId_Id] is missing in 1 out of 2 inputs Field [Donor_Code] is missing in 1 out of 2 inputs Field [Opportunity__c.AccountId.Unique_Id__c] is missing in 1 out of 2 inputs Field [Opportunity_c_Amount] is missing in 1 out of 2 inputs Field [Opportunity_c_AccountId] is missing in 1 out of 2 inputs Field [Payment_Amount__c] is missing in 1 out of 2 inputs Field [Id] is missing in 1 out of 2 inputs Field [Opportunity] is missing in 1 out of 2 inputs Field [Payment_Name] is missing in 1 out of 2 inputs Field [Opportunity__c.Name] is missing in 1 out of 2 inputs Field [Opportunity__c.Amount] is missing in 1 out of 2 inputs Field [Opportunity__c.OwnerId.Id] is missing in 1 out of 2 inputs Field [Opportunity__c.IsClosed] is missing in 1 out of 2 inputs Field [Opportunity_c_AccountId_Unique_Id__c] is missing in 1 out of 2 inputs Field [Record_ID] is missing in 1 out of 2 inputs Field [Opportunity_c_Id] is missing in 1 out of 2 inputs Field [Opportunity__c.AccountId] is missing in 1 out of 2 inputs (02K7F000000l59MUAQ_03C7F000000nK3dUAE).

I checked the fileds of my CSV and Excel they are same, in name and sequence. I am not getting any idea, why i am getting this error.